-- Logs begin at Tue 2022-10-11 06:03:05 UTC, end at Tue 2022-10-11 07:04:33 UTC. -- Oct 11 06:28:21.153186 dv-cinder-854954-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 11 06:28:21.162074 dv-cinder-854954-3-smb devstack@keystone.service[81573]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 06:28:21 2022] *** Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: nodename: dv-cinder-854954-3-smb Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: machine: x86_64 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: clock source: unix Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: pcre jit disabled Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: detected number of CPU cores: 4 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: current working directory: / Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: detected binary path: /usr/bin/uwsgi-core Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: your processes number limit is 47680 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: your memory page size is 4096 bytes Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: detected max file descriptor number: 2048 Oct 11 06:28:21.164045 dv-cinder-854954-3-smb devstack@keystone.service[81573]: lock engine: pthread robust mutexes Oct 11 06:28:21.164801 dv-cinder-854954-3-smb devstack@keystone.service[81573]: thunder lock: enabled Oct 11 06:28:21.164801 dv-cinder-854954-3-smb devstack@keystone.service[81573]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 11 06:28:21.164801 dv-cinder-854954-3-smb devstack@keystone.service[81573]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 06:28:21.202860 dv-cinder-854954-3-smb devstack@keystone.service[81573]: Python main interpreter initialized at 0x5581ec3a29c0 Oct 11 06:28:21.202860 dv-cinder-854954-3-smb devstack@keystone.service[81573]: python threads support enabled Oct 11 06:28:21.202860 dv-cinder-854954-3-smb devstack@keystone.service[81573]: your server socket listen backlog is limited to 100 connections Oct 11 06:28:21.202860 dv-cinder-854954-3-smb devstack@keystone.service[81573]: your mercy for graceful operations on workers is 90 seconds Oct 11 06:28:21.203195 dv-cinder-854954-3-smb devstack@keystone.service[81573]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 06:28:21.203276 dv-cinder-854954-3-smb devstack@keystone.service[81573]: *** Operational MODE: preforking *** Oct 11 06:28:21.203538 dv-cinder-854954-3-smb devstack@keystone.service[81573]: *** uWSGI is running in multiple interpreter mode *** Oct 11 06:28:21.203538 dv-cinder-854954-3-smb devstack@keystone.service[81573]: spawned uWSGI master process (pid: 81573) Oct 11 06:28:21.203749 dv-cinder-854954-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 11 06:28:21.205216 dv-cinder-854954-3-smb devstack@keystone.service[81573]: spawned uWSGI worker 1 (pid: 81584, cores: 1) Oct 11 06:28:21.205216 dv-cinder-854954-3-smb devstack@keystone.service[81573]: spawned uWSGI worker 2 (pid: 81585, cores: 1) Oct 11 06:28:21.205216 dv-cinder-854954-3-smb devstack@keystone.service[81573]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 06:28:25.400833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:28:25.400833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Oct 11 06:28:25.401703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:28:25.401703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Oct 11 06:28:25.401822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:28:25.401822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Oct 11 06:28:25.402227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 06:28:25.402227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Oct 11 06:28:25.450550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:28:25.450763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:28:25.450932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] command line args: [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:28:25.451082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 06:28:25.451166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 06:28:25.451227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:28:25.451291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] command line args: [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 06:28:25.451355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ================================================================================ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:28:25.451585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 06:28:25.451737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.451814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ================================================================================ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 06:28:25.451887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_dir = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.451960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_source = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_dir = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] debug = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_source = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] debug = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.452977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_config_append = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.453997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_dir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_config_append = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_dir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.454979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.455897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.456915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.457990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] publish_errors = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.458896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] publish_errors = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.459921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] standard_threads = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] standard_threads = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_journal = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.460895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_json = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_stderr = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_syslog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_journal = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_json = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_stderr = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.461796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_syslog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.461915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.461990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 06:28:25.462117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.462972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.463918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.464889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.465988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.466935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.467953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.468886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.469973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.470977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.471883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.472924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.473948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.474860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.475895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.476906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.477853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.478992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.479999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.480931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.481918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.482967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.483956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.484844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.485963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.external = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.486968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.external = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.password = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.token = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.487909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.password = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.token = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.488837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489014 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.489945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.490973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.491898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.492889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.493936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.494878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.495975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.496913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.497927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.498858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.499931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.500983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.501976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.502985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.503922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.504913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.505859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.506911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.507852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.508926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509536 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.509929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.510925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.511845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.512944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.513960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.514903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.515970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.516979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.517937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.518885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.519943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.520977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.521964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.522911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.523922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.524953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.525918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.526916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.527997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.528936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.529978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530137 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.530906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.531847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.532962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.533996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.534914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.535974 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:28:25.536665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.536897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 06:28:25.537089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 06:28:25.566171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.566332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.566426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.566492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.566565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.566631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.575042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.575170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.603285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.603480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.603656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.603883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.656528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.656758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.704422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.704638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.705126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.705362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.864991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.865110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.865229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.865320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.865475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.888491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.888634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.888704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.888809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.888934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.889951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.901023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.901148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.913797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.913927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.914964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.915035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.915096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.915216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.915513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.915720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 06:28:25.931866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.931999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.932068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 06:28:25.932130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 06:28:25.932410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.932561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.932633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 06:28:25.932706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 06:28:25.932874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.933689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.943986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.944078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.951081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.951208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.953983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.954109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.954224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.954358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.954541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.954671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.954795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.954922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.955958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.956156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.956639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.956751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.956840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.957031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.957158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.979702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.980042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.981181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.981463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.981588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.981829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.986093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.986373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.986638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.986764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.986901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.987207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.992923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.993230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.993727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.994016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.998783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.999088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.999371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.999643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:25.999770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.999894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:25.999985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.000760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.001029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.001309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.001585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.016158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.016427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.017067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.017366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.020278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.021197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.023525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.023819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.024401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.024702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.028054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.028917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.031212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.032098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.034432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.034728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.035992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.036265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.036562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.036858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.051592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.051881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.052140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.052369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.052844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.053157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.053427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.053696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.059228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.060624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.060798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.062211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.062337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.062525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.063756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.064036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.065254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.065536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.065816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.066097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.066481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.066755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.067050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.067337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.067632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.068010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.077662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.077950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.078232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.078506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.078886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.079167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.079372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.079473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.079647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.079927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.080209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.080588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.080866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.081195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.095136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.097037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.098129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.099980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.101029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.102484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.102941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.104021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.104309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.104433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.104697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.105927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.106210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.106617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.111104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.112559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.113035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.114523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.115440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.115833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.116110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.116384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.117435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.117822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.118092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.118383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.124175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.124462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.124743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.126300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.126594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.126870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.131602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.131884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.132161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.132432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.132699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.132969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.133260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.133539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.133813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.133941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 06:28:26.134094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.135803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.135803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.136857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.137429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 06:28:26.169400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5581ec3a29c0 pid: 81584 (default app) Oct 11 06:28:26.171538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5581ec3a29c0 pid: 81585 (default app) Oct 11 06:28:26.172677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc177-e93c-4f8a-ab60-8cb84d9739ef None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:26.172958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc177-e93c-4f8a-ab60-8cb84d9739ef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:26.173247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc177-e93c-4f8a-ab60-8cb84d9739ef None None] PATH_INFO: `/v3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:26.177410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Oct 11 06:28:26 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:32.951669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:32.952550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:32.952550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:32.959990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:32.965720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:32.966168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:32.966306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:33.035475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: INFO dbcounter [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] Registered counter for database keystone Oct 11 06:28:33.056604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:28:33.064682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:28:33.256794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81584) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 06:28:33.257125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81584) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 06:28:33.315866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:33.317518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:33.454957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:28:34.003750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:34.080641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: INFO dbcounter [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] Registered counter for database keystone Oct 11 06:28:34.105060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 06:28:34.112181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writer thread running {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 06:28:34.229932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698c47b-e852-4991-acaa-897feabeb363 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:34.235377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36079702-707e-4801-8148-8d137edb011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:34.236001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079702-707e-4801-8148-8d137edb011e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:34.236276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079702-707e-4801-8148-8d137edb011e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:34.236539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36079702-707e-4801-8148-8d137edb011e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:34.245777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079702-707e-4801-8148-8d137edb011e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:34.297344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36079702-707e-4801-8148-8d137edb011e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 06:28:34.297606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36079702-707e-4801-8148-8d137edb011e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:34.308611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Oct 11 06:28:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:28:34.317677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:34.342303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f152c96-7897-4147-9def-dda4fd555a38 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:34.351597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:34.353231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:34.353512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:34.353775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] PATH_INFO: `/v3/projects/0d5a17a08f1b4f70b45357309fc45101` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:34.355539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] RBAC: Authorizing `identity:get_project(project_id=0d5a17a08f1b4f70b45357309fc45101)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:34.407732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 06:28:34.408083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accdd14-e063-471c-aacd-b9d8bc71e8ad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:34.412655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:28:34 2022] GET /identity/v3/projects/0d5a17a08f1b4f70b45357309fc45101 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:28:36.494984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405de1-0ad5-4e7c-8f36-161467f20e44 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:36.495568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405de1-0ad5-4e7c-8f36-161467f20e44 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:36.495568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07405de1-0ad5-4e7c-8f36-161467f20e44 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:36.499633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:36.506349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:36.507059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:36.507205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:36.534942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:36.536500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:36.546549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:28:36.807439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07405de1-0ad5-4e7c-8f36-161467f20e44 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:36.830301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07405de1-0ad5-4e7c-8f36-161467f20e44 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:36.839173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:36.839778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:36.840046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:36.840310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:36.848705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:36.850499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ff7d6-2fb6-4563-a2b4-4bbd0df2d768 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:36.859624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Oct 11 06:28:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:28:36.868269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:36.878073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca101c-60ce-48f3-b0cd-fdbc5d68c5a8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:36.884095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:36.884754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:36.885031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:36.885330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] PATH_INFO: `/v3/users/1ad2c06f6db742138db606ece6f8f0c4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:36.886870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ad2c06f6db742138db606ece6f8f0c4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:36.888710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be677d0-4c8c-4eca-9236-e364a783ba34 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:36.890279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Oct 11 06:28:36 2022] GET /identity/v3/users/1ad2c06f6db742138db606ece6f8f0c4 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:39.058971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2446-cf4a-47bc-bb17-60067d687f11 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.059546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2446-cf4a-47bc-bb17-60067d687f11 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.059546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2446-cf4a-47bc-bb17-60067d687f11 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.060860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:39.066118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.066540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.066634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.085478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:39.086656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:39.104831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823c7f-c522-4354-a66b-bf7135e96349 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.105164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823c7f-c522-4354-a66b-bf7135e96349 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.105436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823c7f-c522-4354-a66b-bf7135e96349 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.106751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:39.111676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.111950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.112223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.154975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81585) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 06:28:39.155372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81585) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 06:28:39.170881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:39.203746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:39.205452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:39.307052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:39.431713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.457825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:39.535651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce68bd-f71a-4f6c-9f86-34ece4992f61 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:39.572364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:39.573039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.573326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.573596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.574321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.587232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:39.596090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:39.597194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:28:39.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:39.603326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.674717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a241fc-c172-48a1-ab16-2e56641f69cf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:39.677042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:39.682399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:39.701534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be163c1-d301-417a-94af-62abc92e4ebd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:39.713109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:39.713999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.714283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.714554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.715540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:39.717008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:39.728125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:28:39.728125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:28:39.728125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [parameters: {'id': 'aa6128f96d424d0287ecf53b60cdda4c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 06:28:39.728125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 06:28:39.735450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:39.736053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.736324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.736612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.737286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:39.737582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:39.738971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:28:39.746718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 06:28:39.747566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 06:28:39.748674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 06:28:39.750055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 06:28:39.751103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:28:39.752026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'id': 'aa6128f96d424d0287ecf53b60cdda4c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 06:28:39.753307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:39.754276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 8/15] 10.222.0.30 () {60 vars in 1137 bytes} [Tue Oct 11 06:28:39 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:28:39.755441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.761225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 8/16] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:39.767228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.856623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431f9f-e83d-495b-88ff-ffd2b359d21f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:39.871127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcc44-d719-4fd1-a3c2-d32726875f64 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:39.889455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:39.890316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.890596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.890883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.904770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:39.905430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:39.905705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:39.905973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] PATH_INFO: `/v3/users/1ad2c06f6db742138db606ece6f8f0c4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:39.907133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] RBAC: Authorizing `identity:get_user(user_id=1ad2c06f6db742138db606ece6f8f0c4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:39.908588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:39.908974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:39.910398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/users/1ad2c06f6db742138db606ece6f8f0c4 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:28:39.910502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:39.915780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:28:39.929404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:39.930288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:28:39.931113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:28:39.931113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:28:39.931113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:39.931282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:39.931345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:28:39.936451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:39.958582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:40.019065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe302-585f-4c49-b766-d3975b13392f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:40.037966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3018f-c1ba-4578-81d0-b5e7fdf5de61 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:40.052582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:40.053255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:40.053533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:40.053827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:40.054963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:40.056513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:40.058127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:28:40.063821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:40.073581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:40.074201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:40.074475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:40.074744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:40.075394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:40.075695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:40.077113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee96e03-eae9-476a-a555-1987d6a14697 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:40.094351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:28:40.151064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:40.173158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05891-a8d1-41f0-82ca-86a8fb8460b3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:40.210230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:40.210810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:40.211082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:40.211352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] PATH_INFO: `/v3/domains/default/users/1ad2c06f6db742138db606ece6f8f0c4/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:40.213520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1ad2c06f6db742138db606ece6f8f0c4, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:40.214982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404887c-3a47-42a0-9100-984bd3235ce5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:40.331178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 11/21] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Oct 11 06:28:40 2022] PUT /identity/v3/domains/default/users/1ad2c06f6db742138db606ece6f8f0c4/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:28:42.715885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84fac-bb76-4ff5-860f-4334afed3636 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:42.716394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84fac-bb76-4ff5-860f-4334afed3636 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:42.716493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84fac-bb76-4ff5-860f-4334afed3636 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:42.717972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:42.723733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543a37-bd40-4487-bee1-433b1300b2c0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:42.724566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543a37-bd40-4487-bee1-433b1300b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:42.725067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543a37-bd40-4487-bee1-433b1300b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:42.749264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1543a37-bd40-4487-bee1-433b1300b2c0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:42.751124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1543a37-bd40-4487-bee1-433b1300b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:42.837064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:42.863371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48fa1-946f-4d41-947c-6ab61ae16ba3 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:42.863971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48fa1-946f-4d41-947c-6ab61ae16ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:42.864447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac48fa1-946f-4d41-947c-6ab61ae16ba3 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:42.866370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:42.872142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd06d-9069-4469-a34d-41b7ea329402 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:42.872661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd06d-9069-4469-a34d-41b7ea329402 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:42.873164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd06d-9069-4469-a34d-41b7ea329402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:42.898697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e39fd06d-9069-4469-a34d-41b7ea329402 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:42.900381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e39fd06d-9069-4469-a34d-41b7ea329402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:42.994396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:42.999044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:43.031450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffc3e-b353-45c7-bf94-6067e85aabb8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.031764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffc3e-b353-45c7-bf94-6067e85aabb8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.031997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffc3e-b353-45c7-bf94-6067e85aabb8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.033513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 13/26] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:43.039474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0f09-96e2-4ce9-9e20-70dad46e7a50 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.039764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0f09-96e2-4ce9-9e20-70dad46e7a50 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.040038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0f09-96e2-4ce9-9e20-70dad46e7a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.064015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cf2a0f09-96e2-4ce9-9e20-70dad46e7a50 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:43.065271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cf2a0f09-96e2-4ce9-9e20-70dad46e7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:43.150619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:43.302030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0642e-c8ed-4c27-a018-bb6f204c4053 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.302392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0642e-c8ed-4c27-a018-bb6f204c4053 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.302664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0642e-c8ed-4c27-a018-bb6f204c4053 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.304156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 14/28] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:43.309368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.309659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.309941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.328583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:43.329822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:43.338416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0642e-c8ed-4c27-a018-bb6f204c4053 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:43.448227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:28:43.449044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:43.479958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:43.521458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0642e-c8ed-4c27-a018-bb6f204c4053 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:43.566912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:43.583018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:43.588148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.588573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.589020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.607899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:43.610751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:43.639223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5613cc-7b6a-4d8b-ae95-219ccd27ba0e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:28:43.641309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:43.642352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:28:43.643394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:28:43.643394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:28:43.643394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:43.646020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 15/30] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:43.647179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:43.709607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:43.712741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.713258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.713667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.714544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:43.722090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:43.754288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 16/31] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 11 06:28:43 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:43.757108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:43.824310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6cc7-3d00-40c0-95e5-22b51e01ff9b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:43.860315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:43.869287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:43.869938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:43.871896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:43.872595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:43.874214 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:43.875662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:43.998617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302edba-e7b5-4ec8-bf1b-8731dd10aebb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.026230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:44.046717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.047682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.048153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.048639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.049556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:44.054900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.054900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5d481-fe37-4e08-a49a-f545c43585f3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.057874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 16/32] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 11 06:28:43 2022] POST /identity/v3/roles => generated 225 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:44.058892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.074720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 17/33] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:44.076181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970b58-92bd-41e7-b3c6-4bc0ebf489f7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.076475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970b58-92bd-41e7-b3c6-4bc0ebf489f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.076752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970b58-92bd-41e7-b3c6-4bc0ebf489f7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.082796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 18/34] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:44.087937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970b58-92bd-41e7-b3c6-4bc0ebf489f7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.195665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee099-d4ec-4154-9386-3b6895f1fe0b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.214105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6970b58-92bd-41e7-b3c6-4bc0ebf489f7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.235229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.235930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.236207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.236477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.252047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d01e0fb3-93d6-4059-a407-7d5c0326b59a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:44.260082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:44.260988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:44.261758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 17/35] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:44.262380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.262380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.262380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.285416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:44.287151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:44.349762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:44.366976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.367807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.368080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.368369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.369100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.370548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.377395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 18/36] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:44.377395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.410798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:28:44 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:44.491106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa548-8c2e-4acf-b9c1-c6285aee3398 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.530689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.531246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.531533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.531806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.532513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:44.532817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.534442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30fb11-dc44-4c9a-9e0d-cdcd03fc0b2a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.553532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:44.560102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.606263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:44.681017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae771-5f81-46fb-ae41-8be8360e2d37 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.681426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae771-5f81-46fb-ae41-8be8360e2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.681697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae771-5f81-46fb-ae41-8be8360e2d37 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.683247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 20/39] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:44.685795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f862992-ac8a-40f8-b2de-87c0a51dac98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.687735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae771-5f81-46fb-ae41-8be8360e2d37 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.722831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.723480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.723756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.724033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] PATH_INFO: `/v3/users/1ad2c06f6db742138db606ece6f8f0c4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.725215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] RBAC: Authorizing `identity:get_user(user_id=1ad2c06f6db742138db606ece6f8f0c4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.726671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059116-9e5e-4010-a65d-5314d44ac04d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.728372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 20/40] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:44 2022] GET /identity/v3/users/1ad2c06f6db742138db606ece6f8f0c4 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:44.729498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.729780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.730049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.736862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:44.747449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:44.748801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:44.791186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae771-5f81-46fb-ae41-8be8360e2d37 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.815484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 21/41] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:44.816833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:44.827341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.827967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.828545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.828822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.829817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.831769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.848568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:44.849726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 11 06:28:44 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:28:44.930045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b0cd9-ff11-43aa-8117-91b258a637d6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:44.967926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:44.968580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:44.968851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:44.969153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:44.970328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:44.971851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:44.973700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 22/43] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:44.979806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:45.088240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97245-f0da-496d-969c-75eae66060dc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:45.088736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:45.091177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:45.124285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:45.124898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:45.125196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:45.125463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:45.126196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.domain.id=default, user.id=1ad2c06f6db742138db606ece6f8f0c4) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:45.126496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:45.127949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:45.136342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 22/44] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Oct 11 06:28:44 2022] GET /identity/v3/role_assignments?user.id=1ad2c06f6db742138db606ece6f8f0c4&scope.domain.id=default&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:45.194465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:45.199043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248268cb-d014-4394-a6e5-95ce554756d4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:45.237578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:45.238232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:45.238486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:45.238783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:45.239976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:45.241503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164f7a-c356-4daa-a932-db73d258136d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:45.243143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 23/45] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:28:45.249179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:45.358339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295b48b-d631-4894-b3a2-e2eafbaae5a2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:45.392356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:45.392974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:45.393284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:45.393557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:45.394205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:45.395662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382eeb5-ef63-4e1b-aa3d-295a5c1be458 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:45.425082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:28:45 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:47.532250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041bed-a95f-403f-b9ef-23ebf6393877 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:47.532789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041bed-a95f-403f-b9ef-23ebf6393877 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:47.532789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4041bed-a95f-403f-b9ef-23ebf6393877 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:47.535119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 24/47] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:47.543867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:47.544255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:47.544509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:47.568632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:47.569900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:47.585288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:47.644750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 24/48] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:47.910260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041bed-a95f-403f-b9ef-23ebf6393877 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:48.032349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4041bed-a95f-403f-b9ef-23ebf6393877 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:48.067008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:48.067636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:48.067910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:48.068179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:48.069373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:48.070832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a4592-1970-4c3d-bfb0-196fd79359b5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:48.072385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 25/49] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:48.078626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:48.199306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b6f2d-01a2-42a6-9c95-c48ddabc3a43 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:48.234524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:48.235125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:48.235399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:48.235664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:48.236310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:48.237797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b36eb-6c57-4d2d-8b1a-b25a41af12e8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:48.270864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 25/50] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Oct 11 06:28:48 2022] POST /identity/v3/projects => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:50.391136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187b22-16c6-4a59-8cd3-872bb0d8c114 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:50.391683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187b22-16c6-4a59-8cd3-872bb0d8c114 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:50.391683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49187b22-16c6-4a59-8cd3-872bb0d8c114 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:50.393040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 26/51] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:50.399526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:50.400136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:50.400250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:50.407504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:50.422910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:50.424099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:50.496821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 26/52] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:50.759022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187b22-16c6-4a59-8cd3-872bb0d8c114 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:50.799049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:50.868287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49187b22-16c6-4a59-8cd3-872bb0d8c114 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:50.910733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:50.911355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:50.911631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:50.911895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:50.913104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:50.914532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a661c8-f47c-4de2-a515-7e646f37b753 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:50.916113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:50.924416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:51.025359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feeac0-dfe9-4c5f-994f-e640aca4be9c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:51.055166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:51.061105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:51.061714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:51.061994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:51.062269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:51.062929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:51.064396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce9eb-7a39-4c8d-8fd7-64dc21f2ba45 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:51.095280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 27/54] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:28:50 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:54.328406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4143-fe2b-4e19-b29c-8910f4d8e84f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.328929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4143-fe2b-4e19-b29c-8910f4d8e84f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.328929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4143-fe2b-4e19-b29c-8910f4d8e84f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.330515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 28/55] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:54.344781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a53-e791-4322-a3db-1f25c4dff0b9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.345232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a53-e791-4322-a3db-1f25c4dff0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.345429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a43a53-e791-4322-a3db-1f25c4dff0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.438175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52d3a-3a0b-40b9-b0a7-8f73465e83a2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.438821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52d3a-3a0b-40b9-b0a7-8f73465e83a2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.439312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52d3a-3a0b-40b9-b0a7-8f73465e83a2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.440923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 29/56] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:54.447221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767922-2d67-4053-9e24-f5792611c038 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.447887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767922-2d67-4053-9e24-f5792611c038 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.448351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767922-2d67-4053-9e24-f5792611c038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.480883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-29a43a53-e791-4322-a3db-1f25c4dff0b9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:54.485377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-65767922-2d67-4053-9e24-f5792611c038 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:54.487192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-29a43a53-e791-4322-a3db-1f25c4dff0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:54.493977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-65767922-2d67-4053-9e24-f5792611c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:54.600665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 30/57] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:28:54.611462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18df85-577b-4220-b44b-38e64147eaac None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.612044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18df85-577b-4220-b44b-38e64147eaac None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.612466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18df85-577b-4220-b44b-38e64147eaac None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.613996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 31/58] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:54.620608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd042-0d14-4df3-bac4-9f6af28296e0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.621984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd042-0d14-4df3-bac4-9f6af28296e0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.622471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd042-0d14-4df3-bac4-9f6af28296e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.633239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 28/59] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:54.645805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-427fd042-0d14-4df3-bac4-9f6af28296e0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:54.647292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-427fd042-0d14-4df3-bac4-9f6af28296e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:54.677249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:54.743036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 32/60] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:28:54.860318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8656b7-7dd9-4a18-98cd-d13cedb4a92c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.860718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8656b7-7dd9-4a18-98cd-d13cedb4a92c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.861015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8656b7-7dd9-4a18-98cd-d13cedb4a92c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.862670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 29/61] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:54.867489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:54.867974 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:54.868573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:54.893150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:54.894625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:54.948242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8656b7-7dd9-4a18-98cd-d13cedb4a92c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:54.988835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 33/62] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:54.989607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.107864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8656b7-7dd9-4a18-98cd-d13cedb4a92c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.124032 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.126231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.134207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1812673-7c35-4815-a840-cfeac92a2896 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.145502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.146457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.146881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.147296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.158309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:55.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:55.164297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:55.165649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 30/63] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:55.166285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.178432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.179112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.179370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.179633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.189907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8d48292f-beef-4e25-8bd5-73ec42ff7d57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:55.194834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:55.195649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:28:55.196548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 34/64] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:55.201644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d850-3646-4c26-9edf-6846895dae85 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.202552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d850-3646-4c26-9edf-6846895dae85 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.202841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d850-3646-4c26-9edf-6846895dae85 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.205057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 35/65] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:55.209115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3d850-3646-4c26-9edf-6846895dae85 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.270689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106e319-41ab-42a5-8857-22153ab4bb4b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.305428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.306095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.306368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.306634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.314114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3d850-3646-4c26-9edf-6846895dae85 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.316593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:55.321512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:55.322493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:28:55.323236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 31/66] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:55.324374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.350689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.351341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.351555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.351828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.352512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:55.352873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.354323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcada-3e18-4cd8-86f8-3b216e1af0d5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.362488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 36/67] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.364130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.370265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.370552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.370830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.388807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:55.389962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:55.398949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.424724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4204-994d-4592-8bf6-6e6f4c8833c0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.454126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 37/68] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:55.454946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.459367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.459991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.460277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.460547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.461242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:55.461544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.463405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.472491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 32/69] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.473306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.571437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1846-9ab9-4baf-a7ba-2d32a907af52 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.577698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.580850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1658-a42c-4875-ad2a-a8c3b5ce3251 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.607671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.608312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.608584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.609052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.617638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.618395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.618677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.618951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.619625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:55.619886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:55.619977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.621333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:55.624679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:55.625537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:28:55.626279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 38/70] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:55.626885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.630358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 33/71] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.634257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.635911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.732640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b09962-e2a8-4a8f-a6eb-b2fab29302cf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.747306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b9afb-6153-4a3f-a4ce-c4d7f3ba2e46 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.766328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.766964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.767240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.767510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.779773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.780364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.780544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.780705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.780952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] PATH_INFO: `/v3/users/1ad2c06f6db742138db606ece6f8f0c4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.781871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.782385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] RBAC: Authorizing `identity:get_user(user_id=1ad2c06f6db742138db606ece6f8f0c4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.783665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 39/72] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.783838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.784339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.790023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 34/73] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/users/1ad2c06f6db742138db606ece6f8f0c4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.790023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.817699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.847967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:55.885154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595faecb-43e6-479a-a023-1e13de3071ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.886728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f2ea-9893-4106-ab2a-a18e7e172276 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:55.918072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.918693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.918829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:55.918968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.919243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.919398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:55.919676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:55.919913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:28:55.919996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:55.920216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.921093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:55.921662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.922514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:55.924093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 35/74] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.924839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:55.929730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 40/75] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:55.930546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.019719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.023494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c114aa-5432-47bf-a3e2-1e43675ccd8a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.026225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ff978-df44-411e-8736-39f3c42ac616 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.047929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.056584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.057264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.057550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.057820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.058922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.059921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.060364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.060559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.060838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.061152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.061969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 36/76] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.062313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.062719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.063757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.065433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 41/77] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:28:55 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.066240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.162222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbffb-cbb2-4a9c-a69d-e8e952d5112d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.162706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b61e82-db93-4cf5-8da9-df1a54ef2ed2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.194225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.194855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.195123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.195391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.195639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.196271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.196502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.196596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.196835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.197994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.198093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.199427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.199619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 37/78] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:28:56 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.200368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.201271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 42/79] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:28:56 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.201791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.239162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.263463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.302712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9066c-1917-4c1e-a80f-b247f8b846a8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.303956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a496ec-6b87-4b9b-945b-4a9b5c407316 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.335138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.335737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.336020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.336290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.336962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.337380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.338008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.338283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.338469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.338556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.339661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.341107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.342689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 38/80] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:28:56 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.347475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.366109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 43/81] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:28:56 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:28:56.366914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.458835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f0bf-c7d3-4e3a-be8a-674441cbeb41 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.460543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.486685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89d32-0401-4f0e-9df8-59200680fa11 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.498872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.499642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.499923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.500220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/dc103268404f463d974136311a405915/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.502346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, user_id=dc103268404f463d974136311a405915, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.503846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.505995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.521487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 39/82] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:28:56 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/dc103268404f463d974136311a405915/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:28:56.522099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.542342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.543732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.544207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.545076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/1ad2c06f6db742138db606ece6f8f0c4/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.547557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, user_id=1ad2c06f6db742138db606ece6f8f0c4, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.549842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.572047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 44/83] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:28:56 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/1ad2c06f6db742138db606ece6f8f0c4/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:28:56.572047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.658664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ecd55-50e5-444e-bdf1-111378fea0ae None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.700618 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.701395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.701687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.701969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/dc103268404f463d974136311a405915/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.704759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, user_id=dc103268404f463d974136311a405915, role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.706375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.711253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431acc-692d-42f8-94ab-fb9ae4188f35 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.724625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 40/84] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:28:56 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/dc103268404f463d974136311a405915/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:28:56.763561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.764263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.764542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.764814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] PATH_INFO: `/v3/projects/7717d15ba8824e438acd905c48ac431b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.766226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] RBAC: Authorizing `identity:get_project(project_id=7717d15ba8824e438acd905c48ac431b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.767937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a523-61e3-4a7c-855d-8bcdadfb3120 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.770011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 45/85] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:28:56 2022] GET /identity/v3/projects/7717d15ba8824e438acd905c48ac431b => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:28:56.776574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:56.809669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:56.909669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69d63-82d8-49a7-a04e-1ed37193a17c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:56.950709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:56.951679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:56.952122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:56.952541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] PATH_INFO: `/v3/projects/7717d15ba8824e438acd905c48ac431b/users/dc103268404f463d974136311a405915/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:56.955441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] RBAC: Authorizing `identity:create_grant(project_id=7717d15ba8824e438acd905c48ac431b, user_id=dc103268404f463d974136311a405915, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:28:56.957498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1abb1-523f-4ecd-be6d-d409a513a882 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:28:56.973708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 41/86] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:28:56 2022] PUT /identity/v3/projects/7717d15ba8824e438acd905c48ac431b/users/dc103268404f463d974136311a405915/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:28:59.220689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af599c9-8814-4da0-9d76-3928c0948671 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.221281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af599c9-8814-4da0-9d76-3928c0948671 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.221281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af599c9-8814-4da0-9d76-3928c0948671 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.222854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 46/87] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:28:59.238850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245324df-c7d9-48e5-b547-93df86ceaa3a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.239350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245324df-c7d9-48e5-b547-93df86ceaa3a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.239422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245324df-c7d9-48e5-b547-93df86ceaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.260653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-245324df-c7d9-48e5-b547-93df86ceaa3a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:59.261904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-245324df-c7d9-48e5-b547-93df86ceaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:59.355061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 42/88] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:28:59.441300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0951-3815-4f89-9926-ea3f8afb6217 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.441626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0951-3815-4f89-9926-ea3f8afb6217 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.441852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c0951-3815-4f89-9926-ea3f8afb6217 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.443491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 47/89] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:59.450913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34845-f76c-4ce3-bff4-f78f8f5c88b1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.451208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34845-f76c-4ce3-bff4-f78f8f5c88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.451483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f34845-f76c-4ce3-bff4-f78f8f5c88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.478144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c5f34845-f76c-4ce3-bff4-f78f8f5c88b1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:59.479277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c5f34845-f76c-4ce3-bff4-f78f8f5c88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:59.487380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:59.573058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 43/90] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:59.689221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690fb6-df83-46ec-a16a-b829790a17ee None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.689576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690fb6-df83-46ec-a16a-b829790a17ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.689775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690fb6-df83-46ec-a16a-b829790a17ee None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.691293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 48/91] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:28:59.696517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.696804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.697106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.722061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:28:59.723271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:28:59.771973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690fb6-df83-46ec-a16a-b829790a17ee None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:28:59.804900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 44/92] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:28:59.858754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:28:59.921144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690fb6-df83-46ec-a16a-b829790a17ee None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:28:59.963323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:28:59.964021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:28:59.964301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:28:59.964573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:28:59.981811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:28:59.987285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:28:59.988186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:28:59.988929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 49/93] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:28:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:28:59.996583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.099889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.132083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd21d7-27df-4308-b2bb-e22080946c42 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.167894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.168519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.168798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.169093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.169761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:00.170060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.171456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.180303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 45/94] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:00.186020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.186244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.299591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a12b4-2a8b-406f-b209-9f6836c40f7a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.301966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.308240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127fce0-1bb2-4ba7-930a-9ee299e2eb00 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.336591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.337292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.337564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.337831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.345402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.346358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.346824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.347333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.347972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:00.348762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.350503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3774e-33d2-405a-9005-fcb1d92441c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.352462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 46/95] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:00.352884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:00.353988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 50/96] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:00.354735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.357532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a53b-e789-4e78-9065-156d906d8ec0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.358029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a53b-e789-4e78-9065-156d906d8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.358665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a53b-e789-4e78-9065-156d906d8ec0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.364559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 47/97] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:00.364559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7830a0-8658-4ae5-87d7-42aa0daac01e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.364559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7830a0-8658-4ae5-87d7-42aa0daac01e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.364846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7830a0-8658-4ae5-87d7-42aa0daac01e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.370002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 48/98] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:00.370002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7830a0-8658-4ae5-87d7-42aa0daac01e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.370176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.468990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed1af-0d06-46ce-9fff-41af6e50d85f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.478797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7830a0-8658-4ae5-87d7-42aa0daac01e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.504520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.505185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.505464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.505917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.513880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.514499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.514776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.515049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.516055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:00.520824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:00.521779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:00.522540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:00.527011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 51/99] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:00.527570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.555336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.593787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.595514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aa1a4-8067-4c7f-a790-07bc6747dda1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.597796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.650759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143579d7-07f9-4198-95e4-952b0da2737f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.686308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.686920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.687194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.687488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.688154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:00.688449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.689895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a00c9-9ddb-43e4-a413-c32f7300796b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.697976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 52/100] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:00.704578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 49/101] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:00.704578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6424-a066-4385-a1ed-b9fee1bf1a05 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.704578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6424-a066-4385-a1ed-b9fee1bf1a05 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.704578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6424-a066-4385-a1ed-b9fee1bf1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.704929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.704929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.704929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.720295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-44df6424-a066-4385-a1ed-b9fee1bf1a05 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:00.721520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:00.721614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-44df6424-a066-4385-a1ed-b9fee1bf1a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:00.722666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:00.788345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 53/102] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:00.789229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.789352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 50/103] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:00.790580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8bfb-e2c4-4006-a5a3-5794db403e57 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.790925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8bfb-e2c4-4006-a5a3-5794db403e57 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.791197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf8bfb-e2c4-4006-a5a3-5794db403e57 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.797530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 51/104] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:00.797530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf8bfb-e2c4-4006-a5a3-5794db403e57 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.807023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.828739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:00.902384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05f36b-719c-432c-8a2f-c3dc3c9ea47b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.907655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf8bfb-e2c4-4006-a5a3-5794db403e57 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:00.942722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.943889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.944433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.944944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] PATH_INFO: `/v3/users/1ad2c06f6db742138db606ece6f8f0c4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.945347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:00.946057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.946430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.946770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.947046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] RBAC: Authorizing `identity:get_user(user_id=1ad2c06f6db742138db606ece6f8f0c4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.947558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:00.947954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:00.949067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.949597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1001-00ed-4b61-863c-4bfe9b3e9369 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:00.951030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 52/105] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/users/1ad2c06f6db742138db606ece6f8f0c4 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:00.951989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:00.959873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 54/106] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:00.961265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4361-b118-488d-8d52-33395a948687 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:00.961620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4361-b118-488d-8d52-33395a948687 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:00.962548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4361-b118-488d-8d52-33395a948687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:00.985930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-babe4361-b118-488d-8d52-33395a948687 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:00.987791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-babe4361-b118-488d-8d52-33395a948687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:01.058373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.062019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e4ef2-ce57-4936-8b8b-76e9f63364af None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.080824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 55/107] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:01.085140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4361-b118-488d-8d52-33395a948687 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.092853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.111179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.111831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.112100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.112362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.113558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.115007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.116651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 53/108] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:00 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:01.117413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.187450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4361-b118-488d-8d52-33395a948687 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.223415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd67a17-15ac-4c16-8083-a9efbf307ebb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.225200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.226064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.226406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.226689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.258341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.259034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.259316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.259592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.260736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.262224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.263988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 54/109] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:01.264578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.298271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.299968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.300512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.309856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.371354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c720756-262d-4ee6-a8db-e740cc8fa8a9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.401383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 56/110] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:01.401383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.407883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.408528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.408855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.409170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.410349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.411809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.418585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 55/111] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:01.418585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.500238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aece44-b72c-48f7-8287-dc95e839755b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.509598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.513546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097c7d5-e0b2-4ddd-90eb-e134796f21bd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.516254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.535156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.535791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.536067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.536344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.546271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:01.548574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.549207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.549480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.549745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.550464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] RBAC: Adding query filter params (role.id=13d7deed477f4bb486fee9fa5d749deb, scope.project.id=e9c96055ce3742879e28dbd6c951d83b, user.id=dc103268404f463d974136311a405915) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:01.550762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:01.551176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:01.552114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:01.552875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:01.553464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.553537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 57/112] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:01.553537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.562904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 56/113] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/role_assignments?user.id=dc103268404f463d974136311a405915&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:01.573394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.668120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e8a1-8931-4689-b783-b71f83c614d8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.688974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1333f7-06ae-47b9-854f-8151ffc3e6ae None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.705526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.706162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.706445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.707075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.729372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.730597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.730951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.731225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.743449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:01.744787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:01.749903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:01.750799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:01.751586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 57/114] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:01.752202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.783442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.784916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.794154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.866289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82694694-b679-41b9-942d-f4c7e752b2b8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:01.884322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 58/115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:01.885166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.902835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:01.903472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:01.903749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:01.904186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:01.905454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:01.906928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:01.908583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 58/116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:01.909405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:01.950078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:01.984498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94513-ed58-43d7-99a4-8ee11bf82049 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.003044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.009376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae98af4-286b-4903-9dc9-a8357e094cc8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.016895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.017530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.017809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.018076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.018719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.020176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.042815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.043429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.043702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.043966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.044613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:02.044911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.046290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 59/117] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:29:01 2022] POST /identity/v3/projects => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:02.046408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.050007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.054936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 59/118] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.055635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.162075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e551-1997-47fe-bb22-246d21cc5189 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.174260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ee64b-f413-4aff-b76a-65df59bba6f6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.185345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.202200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.202934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.203272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.203608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.204360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:02.204726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.206261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.214775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.215534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.215879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.221489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.221633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 60/119] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.221633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.221993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.223467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.225329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.230801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.261585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.335324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ec8c-a821-4141-96c2-300336b9b3c7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.341270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee43f-f86f-40c3-b1b5-84dac3d6fed0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.370800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.371416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.371696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.371966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.372698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=e9c96055ce3742879e28dbd6c951d83b, user.id=1ad2c06f6db742138db606ece6f8f0c4) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:02.373027 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.374492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.379213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.380200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.380589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.380952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] PATH_INFO: `/v3/users/4da4a8a409d2472c92e50c94f709f303` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.381818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/role_assignments?user.id=1ad2c06f6db742138db606ece6f8f0c4&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.391219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.399230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] RBAC: Authorizing `identity:get_user(user_id=4da4a8a409d2472c92e50c94f709f303)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.401124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.403269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 61/122] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/users/4da4a8a409d2472c92e50c94f709f303 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.404031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.468268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.516187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.539145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7f45-d4b6-4981-b7ea-82aa0a1c3be6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.543541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd1aed-3d06-4098-a22e-1e704bfff59f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.584594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.585486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.585906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.586311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.588020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] RBAC: Adding query filter params (role.id=2fe08520986d4aa7bb1cb6e78c716101, scope.project.id=e9c96055ce3742879e28dbd6c951d83b, user.id=dc103268404f463d974136311a405915) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:02.588488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.590568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.595995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.596645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.596762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/role_assignments?user.id=dc103268404f463d974136311a405915&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=2fe08520986d4aa7bb1cb6e78c716101 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.599853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.599853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] PATH_INFO: `/v3/users/dc103268404f463d974136311a405915` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.600033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.600530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] RBAC: Authorizing `identity:get_user(user_id=dc103268404f463d974136311a405915)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.603367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.605035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 62/124] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/users/dc103268404f463d974136311a405915 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.610437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.739449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07ff4-a35f-4651-9aac-1249f4904c2d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.755003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71adca-6843-4f5f-ba9d-2f927739ff9c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.755362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.779674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.780228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.780553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.780829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.812691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.813611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.813890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.814168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.815324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.817806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.819573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:02.825894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.851593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:02.863108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.864601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.948944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398453aa-0dea-44d6-96f8-e152df902a38 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:02.976827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 63/126] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 06:29:02.982812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:02.984886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:02.985639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:02.985916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:02.986186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/4da4a8a409d2472c92e50c94f709f303/roles/1ac1afa9131b4b24bdcc13e8fed36811` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:02.988118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, user_id=4da4a8a409d2472c92e50c94f709f303, role_id=1ac1afa9131b4b24bdcc13e8fed36811)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:02.989641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:02.999414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:03.006267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 64/127] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:02 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/users/4da4a8a409d2472c92e50c94f709f303/roles/1ac1afa9131b4b24bdcc13e8fed36811 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:29:03.097464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a4a17-158e-45e0-a016-683e29b448a4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:03.132611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:03.133298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:03.133588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:03.133892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] PATH_INFO: `/v3/projects/7717d15ba8824e438acd905c48ac431b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:03.135060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] RBAC: Authorizing `identity:get_project(project_id=7717d15ba8824e438acd905c48ac431b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:03.136546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bba51c-fc81-44bb-ba42-4279f736c358 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:03.138428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 64/128] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:02 2022] GET /identity/v3/projects/7717d15ba8824e438acd905c48ac431b => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:03.144344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:03.233326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:03.258442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c70d5-4bb3-4fcd-88e2-fc5bd8b80e5a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:03.292445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:03.293097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:03.293374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:03.293642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:03.294365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] RBAC: Adding query filter params (role.id=13d7deed477f4bb486fee9fa5d749deb, scope.project.id=7717d15ba8824e438acd905c48ac431b, user.id=dc103268404f463d974136311a405915) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:03.294669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:03.296108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7a7d-ca7f-4f4b-a0d5-f22c9df1c8a6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:03.301989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 65/129] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:03 2022] GET /identity/v3/role_assignments?user.id=dc103268404f463d974136311a405915&scope.project.id=7717d15ba8824e438acd905c48ac431b&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:04.344271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244057e1-fcdf-462d-9da6-a0fd22fc6446 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:04.344819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244057e1-fcdf-462d-9da6-a0fd22fc6446 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:04.344819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244057e1-fcdf-462d-9da6-a0fd22fc6446 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:04.346186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 65/130] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:04.351735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:04.352120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:04.352289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:04.371669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:04.372889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:04.444785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 66/131] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:04.711439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244057e1-fcdf-462d-9da6-a0fd22fc6446 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:04.794512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:04.814486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244057e1-fcdf-462d-9da6-a0fd22fc6446 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:04.848968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:04.849616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:04.849888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:04.850153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:04.851289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:04.852791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67022d-8d11-4a92-9074-c48bd5a90de0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:04.854408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 66/132] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:04.860059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:04.929125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:04.960397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf58d-e004-434a-9e6f-d7b6eda817bb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:04.994746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:04.995273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:04.995547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:04.995807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:04.996451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:04.997962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bc8dd-0471-4135-9172-c2e0b72c4990 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:05.019136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 67/133] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:04 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:05.175507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d960-3442-42fd-8940-856e1d398f49 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:05.175757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d960-3442-42fd-8940-856e1d398f49 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:05.176046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d960-3442-42fd-8940-856e1d398f49 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:05.177434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 67/134] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:05.183524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:05.183814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:05.184113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:05.203369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:05.204566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:05.271497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 68/135] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:05.533745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d960-3442-42fd-8940-856e1d398f49 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:05.650951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d960-3442-42fd-8940-856e1d398f49 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:05.685555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:05.686206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:05.686484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:05.686758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:05.697309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:05.702351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:05.703212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:05.703983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 68/136] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:05.711067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:05.781459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:05.814211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1c548-ee7c-40db-929d-d8f46abe7605 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:05.849574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:05.850205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:05.850533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:05.850807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:05.851486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:05.851790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:05.853288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:05.862133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 69/137] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:05.867715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:05.885449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:05.971719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138f0e5-9a1d-441f-b2e4-a7977edf6a95 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:06.006975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:06.007644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:06.007925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:06.008197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] PATH_INFO: `/v3/users/4da4a8a409d2472c92e50c94f709f303` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:06.009582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] RBAC: Authorizing `identity:get_user(user_id=4da4a8a409d2472c92e50c94f709f303)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:06.011136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:06.013304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 69/138] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:05 2022] GET /identity/v3/users/4da4a8a409d2472c92e50c94f709f303 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:06.019291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:06.123379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbedb27-4b16-4640-a64d-36c87bfdbd93 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:06.142231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:06.160914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:06.161870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:06.162195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:06.162475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:06.234217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:06.235698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:06.333099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 70/139] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:06.338980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:06.421291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:06.444259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdfa2c-3ebf-43be-926f-9d9554af018e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:06.480263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:06.480962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:06.481280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:06.481553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:06.482748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:06.484227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f95cc-eef7-4f77-a49e-e8c5aad5959a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:06.486098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 70/140] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:06 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:06.491847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:06.517402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:06.593670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e1e0-21bd-469d-a823-f0828e7cf7f7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:06.627631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:06.628256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:06.628534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:06.628813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:06.629576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] RBAC: Adding query filter params (role.id=1ac1afa9131b4b24bdcc13e8fed36811, scope.project.id=e9c96055ce3742879e28dbd6c951d83b, user.id=4da4a8a409d2472c92e50c94f709f303) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:06.629885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:06.631343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215faa0c-db42-49d7-89a1-e2b442eaaa87 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:06.637322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 71/141] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:06 2022] GET /identity/v3/role_assignments?user.id=4da4a8a409d2472c92e50c94f709f303&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=1ac1afa9131b4b24bdcc13e8fed36811 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:07.288413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce814-de9b-4886-a41e-199e951e901c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.289241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce814-de9b-4886-a41e-199e951e901c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.289241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce814-de9b-4886-a41e-199e951e901c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.290689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 71/142] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:07.296459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02582a-17ee-4841-b277-b74428981d34 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.297183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02582a-17ee-4841-b277-b74428981d34 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.297183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02582a-17ee-4841-b277-b74428981d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.316897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bd02582a-17ee-4841-b277-b74428981d34 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:07.318137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd02582a-17ee-4841-b277-b74428981d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:07.389609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 72/143] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:07.407136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ccf2-c464-4dcc-9ceb-07a325347469 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.407486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ccf2-c464-4dcc-9ceb-07a325347469 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.407655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9ccf2-c464-4dcc-9ceb-07a325347469 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.409268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 72/144] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:07.414558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.414812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.415194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.434109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:07.435282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:07.442659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:07.498662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeb6f-59a2-44c9-8190-8a7c60503357 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.498950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeb6f-59a2-44c9-8190-8a7c60503357 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.499292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdeb6f-59a2-44c9-8190-8a7c60503357 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.500660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 73/145] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:07.505944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.506236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.506507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.511276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 73/146] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:07.528961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:07.530183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:07.604757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 74/147] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:07.647617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:07.745971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553467d-f8ab-45f9-b146-f5b480ddddb7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:07.775587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:07.782612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:07.783262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.783523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.783785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.794868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:07.800146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:07.801190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:07.802096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 74/148] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:07.807371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:07.811167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:07.860255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:07.885979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde3bb-e0b2-410b-88c4-3e2bb99e3ac7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:07.908199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb943-7389-4d32-8fd3-98c5e9ab4b48 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:07.919167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:07.919814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.920077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.920340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.930515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:07.935375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:07.936263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:07.937036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 75/149] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:07.937684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:07.945978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:07.946703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:07.946977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:07.947240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:07.947905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:07.948202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:07.949636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:07.958271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 75/150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:07.959039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.018043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.034274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d2793-2279-406d-b88e-6e09c2439204 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.055361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925855d-d231-429c-a08d-a8be18302861 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.067696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.068325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.068593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.068866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.070021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.071602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.077103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 76/151] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:08.077103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.080164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.089113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.089728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.090005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.090271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.090964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:08.091262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.092633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.100461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 76/152] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:08.100461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.172934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021c8c-4c0e-4374-83c8-1e514fecebbf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.204662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1e0d5-bac0-400b-acd9-e1e4c3254de8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.206061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.207046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.207345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.207603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] PATH_INFO: `/v3/users/152b2647af3c4fc683a544954c6cc69c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.220879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] RBAC: Authorizing `identity:get_user(user_id=152b2647af3c4fc683a544954c6cc69c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.222391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.228845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 77/153] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:08 2022] GET /identity/v3/users/152b2647af3c4fc683a544954c6cc69c => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:08.228845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.235351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.244414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.245024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.245329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.245595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.246238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.247684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.269581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 77/154] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:08 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:08.270431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.291752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.338102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb119c6a-d370-43c8-8b45-4814ef01ea51 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.380367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.381008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.381404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.381684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] PATH_INFO: `/v3/users/152b2647af3c4fc683a544954c6cc69c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.382712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e25e-abd3-4e17-8940-c79897ecb491 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.383172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] RBAC: Authorizing `identity:get_user(user_id=152b2647af3c4fc683a544954c6cc69c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.384383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.386225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 78/155] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:08 2022] GET /identity/v3/users/152b2647af3c4fc683a544954c6cc69c => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:08.391971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.428526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.429154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.429409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.429679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.431636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.433142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.435057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 78/156] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:08 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:08.440648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.501355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.503845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4a3b5-555a-4fed-86a5-227385ea1155 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.538711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:08.547265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.547898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.548173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.548480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.549812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.551433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.552903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 79/157] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:08 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:08.555249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631862f-411c-43d3-8f86-22ef8f41c849 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.560052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:08.598929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.599626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.599901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.600162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/152b2647af3c4fc683a544954c6cc69c/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.603108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, user_id=152b2647af3c4fc683a544954c6cc69c, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.605122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ec02-957d-4eb2-854b-365a7578b98e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.621423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 79/158] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:08 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/152b2647af3c4fc683a544954c6cc69c/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:29:08.693295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7c15e-411d-4336-af6d-1405f65ce306 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:08.733566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:08.734253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:08.734528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:08.734795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/152b2647af3c4fc683a544954c6cc69c/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:08.737304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, user_id=152b2647af3c4fc683a544954c6cc69c, role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:08.738780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07696a7-a4d4-4b77-9479-62ac60eb756b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:08.757116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 80/159] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:08 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/152b2647af3c4fc683a544954c6cc69c/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:10.556027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590458c-52c8-41af-b328-94e7addd5b05 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.556580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590458c-52c8-41af-b328-94e7addd5b05 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.556580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590458c-52c8-41af-b328-94e7addd5b05 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.558098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 80/160] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:10.564191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474db0b-f40b-472a-a615-a3a03457e36a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.564625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474db0b-f40b-472a-a615-a3a03457e36a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.564828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474db0b-f40b-472a-a615-a3a03457e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.584800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9474db0b-f40b-472a-a615-a3a03457e36a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:10.586081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9474db0b-f40b-472a-a615-a3a03457e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:10.644775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:10.659946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 81/161] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:10.722545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7f04-514b-4cbe-bdb4-fb8cb368ad2d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.722887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7f04-514b-4cbe-bdb4-fb8cb368ad2d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.723093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b7f04-514b-4cbe-bdb4-fb8cb368ad2d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.724727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 81/162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:10.730079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee938c-dea5-4722-8ccc-8c90352c7ca4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.730360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee938c-dea5-4722-8ccc-8c90352c7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.730630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee938c-dea5-4722-8ccc-8c90352c7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.749071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ccee938c-dea5-4722-8ccc-8c90352c7ca4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:10.750262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ccee938c-dea5-4722-8ccc-8c90352c7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:10.824376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 82/163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:10.889220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f664-0050-49d3-887f-cc6ab77bb716 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.889561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f664-0050-49d3-887f-cc6ab77bb716 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.889757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4f664-0050-49d3-887f-cc6ab77bb716 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.891399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 82/164] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:10.896664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:10.897123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:10.897546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:10.915980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:10.917427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:10.924373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4f664-0050-49d3-887f-cc6ab77bb716 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.001072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 83/165] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:11.031419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4f664-0050-49d3-887f-cc6ab77bb716 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.042215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.065768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.066668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.067170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.067437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.081077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:11.087120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:11.088058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:11.088810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 83/166] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:11.094784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.117628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.161457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.220644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd3b3-f76d-4b08-ad8a-398fa8ea7cae None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.226247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d6d0e-9681-4d42-8a7e-8f7544ecb632 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.254257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.255108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.255539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.255820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.256489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:11.256790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.258254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01f494-0253-4c18-b312-74752a0939a2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.263153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.263801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.264077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.264338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.265539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.270916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 84/167] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:11.271042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.271114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae56da-524a-4727-8a9f-50fbfa869864 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.271114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae56da-524a-4727-8a9f-50fbfa869864 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.271114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae56da-524a-4727-8a9f-50fbfa869864 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.271114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 85/168] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:11.271651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae56da-524a-4727-8a9f-50fbfa869864 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.276354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 84/169] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:11.276354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.312396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.371956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ba1b-9e98-4336-a3ba-180c7ce226fe None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.372342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae56da-524a-4727-8a9f-50fbfa869864 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.382978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.404578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.405214 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.405488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.405748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.406389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.406968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.407599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.407813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c3add-ac62-4e31-9acf-b2e8b4f76ba1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.407942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.408115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] PATH_INFO: `/v3/users/98cb2703ac0d45719339d37ff24deaa9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.421572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] RBAC: Authorizing `identity:get_user(user_id=98cb2703ac0d45719339d37ff24deaa9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.423397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.425053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 86/170] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/users/98cb2703ac0d45719339d37ff24deaa9 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:11.425992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.432653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 85/171] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:11 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:11.434170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.434455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.434907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.454891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:11.456148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:11.535948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 86/172] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:11.542138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.546635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be27781-0ffd-4abe-86a3-29948df8dcbb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.581073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.597195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.597880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.598197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.598464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.611556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:11.616722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:11.617816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:11.618674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 87/173] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:11.624055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.657143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.683456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848fc3f-522a-4776-b0c2-f549ebb40a54 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.726762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.727476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.727744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.728008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.729382 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.730839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.732618 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 87/174] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:11.738269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.743418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8e6f6-c07e-4a6c-b0b1-429dd5f7e49b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.788194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.788194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.788194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.788194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.788795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:11.789166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.791019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.805506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 88/175] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:11.807366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.851945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.865442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5817-04fc-44f2-9c7e-47243db1d9dc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.912939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.913324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:11.914449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.914970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.915370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/98cb2703ac0d45719339d37ff24deaa9/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.918013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, user_id=98cb2703ac0d45719339d37ff24deaa9, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.919453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.921526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37f574-5ee2-46ca-98e2-f21b4039d381 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:11.937565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 88/176] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:11 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/98cb2703ac0d45719339d37ff24deaa9/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:29:11.939068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:11.961279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:11.962425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:11.962912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:11.963346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] PATH_INFO: `/v3/users/152b2647af3c4fc683a544954c6cc69c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:11.964934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] RBAC: Authorizing `identity:get_user(user_id=152b2647af3c4fc683a544954c6cc69c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:11.967012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:11.969259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 89/177] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/users/152b2647af3c4fc683a544954c6cc69c => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:11.978325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.067095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d158a4-e0f0-463f-bc8e-9d037ce30a91 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.110313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.111225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.111956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.112232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.126176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:12.131581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:12.132497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:12.133329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 89/178] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:12.142248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.175026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:12.193322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334163-3c67-4c51-bae8-9533234d6806 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.241577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.242215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.242487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.242759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.280712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:12.288647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4542585-0ad9-4e72-9baa-4d3a559a0bb6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.353158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.353779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.354047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.354307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.354969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:12.355263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:12.356784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:12.361711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:12.363191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:12.377149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 90/179] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:12.382683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.523858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:12.537448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 90/180] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:12.543495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.605028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630079b-83c7-4d03-a2f6-da6d5f2e2edb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.621456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:12.670998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df4ff-8588-40f1-8862-a706f3399c67 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.675368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.676022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.676295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.676561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] PATH_INFO: `/v3/users/152b2647af3c4fc683a544954c6cc69c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.684324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] RBAC: Authorizing `identity:get_user(user_id=152b2647af3c4fc683a544954c6cc69c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:12.685813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:12.687448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 91/181] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:12 2022] GET /identity/v3/users/152b2647af3c4fc683a544954c6cc69c => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:12.695584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.737879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.739963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.740238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.740505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.741803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:12.743356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:12.746170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 91/182] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:12 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:12.755307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:12.885664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b050-407e-4fe2-bf7a-7cd825826078 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.940277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba33ab-f8c7-489b-a85d-1de08fe041b4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:12.951997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:12.952644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:12.952922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:12.953228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:12.977979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:12.993360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:13.003592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:13.004215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:13.005545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:13.006051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:13.006802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=16a2c43deb124812862e2ea4601fbf45, user.id=152b2647af3c4fc683a544954c6cc69c) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:13.007931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:13.010193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:13.022047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 92/183] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:12 2022] GET /identity/v3/role_assignments?user.id=152b2647af3c4fc683a544954c6cc69c&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:13.104812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:13.106345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:13.224932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 92/184] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 06:29:13.230554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:13.338703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7249d6d-7173-47ed-8f8e-c964ea242cf2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:13.377751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:13.378764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:13.379263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:13.379742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:13.381125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:13.382791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdbfb4-e4da-440c-9e98-f0786d37eeae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:13.385680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 93/185] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:13 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:13.390759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:13.439661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:13.502963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43985257-3318-4eea-99de-fe3dd7e9150a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:13.540801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:13.541463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:13.541733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:13.541998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:13.542729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] RBAC: Adding query filter params (role.id=2fe08520986d4aa7bb1cb6e78c716101, scope.project.id=16a2c43deb124812862e2ea4601fbf45, user.id=152b2647af3c4fc683a544954c6cc69c) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:13.543030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:13.544469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078c27-ad31-470e-acc4-cc6a101854e5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:13.550730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 93/186] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:13 2022] GET /identity/v3/role_assignments?user.id=152b2647af3c4fc683a544954c6cc69c&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=2fe08520986d4aa7bb1cb6e78c716101 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:13.935639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae24d-49b6-4bd3-bb36-5bdfcc97a229 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:13.936188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae24d-49b6-4bd3-bb36-5bdfcc97a229 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:13.936188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fae24d-49b6-4bd3-bb36-5bdfcc97a229 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:13.937713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 94/187] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:13.942853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4520-bbde-43bf-91fe-642861a0219a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:13.943308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4520-bbde-43bf-91fe-642861a0219a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:13.943383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f4520-bbde-43bf-91fe-642861a0219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:13.964073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-398f4520-bbde-43bf-91fe-642861a0219a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:13.965345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-398f4520-bbde-43bf-91fe-642861a0219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:14.037602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 94/188] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:14.077152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53777-0e87-4b50-a765-2a6128313620 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.077475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53777-0e87-4b50-a765-2a6128313620 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.077707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53777-0e87-4b50-a765-2a6128313620 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.079225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 95/189] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:14.084667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.084937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.085269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.104062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:14.105283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:14.134956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:14.174741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 95/190] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:14.299191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb53777-0e87-4b50-a765-2a6128313620 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.367331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:14.410825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb53777-0e87-4b50-a765-2a6128313620 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:14.441142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.446001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:14.446657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.446930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.447167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.448310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:14.449811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:14.451359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 96/191] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:14.457091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.543997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b747a1c-dffb-43f9-8dcd-584cf5fddc64 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:14.555619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1639f7-9190-4d27-9448-0889e8fdb55b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:14.580678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:14.580989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:14.582070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.582381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.582722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.590240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:14.590847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.591125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.591388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.592029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:14.592735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:14.593509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37384237-c1a1-4a31-b7ff-badc3b421e51 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-949d7996-20da-426b-88f5-52c977a0b45f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:14.597727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:14.598601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:14.599359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 96/192] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:14.600426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bedaff-0af7-4f4d-9cc2-909b704914f4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.600426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bedaff-0af7-4f4d-9cc2-909b704914f4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.600647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bedaff-0af7-4f4d-9cc2-909b704914f4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.602765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 97/193] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:14.605119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bedaff-0af7-4f4d-9cc2-909b704914f4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.617576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 97/194] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:14 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:29:14.633249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.633249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.633249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.637923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:14.639161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:14.641670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:14.719398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 98/195] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:14.738047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bedaff-0af7-4f4d-9cc2-909b704914f4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:14.775476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:14.776116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.776390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.776660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.777380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:14.777682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:14.779104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:14.788394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 98/196] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:14.794174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.899953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb514cf5-6d8b-4f90-9ba8-a3c26cda6a50 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:14.913913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:14.937592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:14.938367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:14.938530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:14.938799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] PATH_INFO: `/v3/users/505c1b6685bd41f7b581d87c6f73118a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:14.953909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] RBAC: Authorizing `identity:get_user(user_id=505c1b6685bd41f7b581d87c6f73118a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:14.955402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:14.957726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 99/197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/users/505c1b6685bd41f7b581d87c6f73118a => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:14.963554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:14.987895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.085498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:15.102239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495e849-3249-4adc-a646-3818e98dc964 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.109614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367dba3-250e-4b72-bc2d-44299c59f6da None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.145600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.145977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.146582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.146862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.147140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.147472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.147924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.148403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.150349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:15.152174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:15.154149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 99/198] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:15.158915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:15.160058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:15.166212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:15.167089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:15.167861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 100/199] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:15.174919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.217055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:15.300112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf40a-addf-42c5-ae5a-4cbfb8ef8076 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.304853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29641c-401b-4967-abe1-af85aac20ea0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.345133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.345773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.346030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.346293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.346963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:15.347266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:15.347934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.348658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:15.349038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.349511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.350239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/505c1b6685bd41f7b581d87c6f73118a/roles/1ac1afa9131b4b24bdcc13e8fed36811` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.352910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, user_id=505c1b6685bd41f7b581d87c6f73118a, role_id=1ac1afa9131b4b24bdcc13e8fed36811)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:15.355119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:15.357413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 101/200] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:15.363944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.373703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 100/201] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:15 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/users/505c1b6685bd41f7b581d87c6f73118a/roles/1ac1afa9131b4b24bdcc13e8fed36811 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:15.471496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:15.480542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f74-05ac-4d9d-9543-af5651ab14c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.518949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.519748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.520080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.520413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] PATH_INFO: `/v3/users/98cb2703ac0d45719339d37ff24deaa9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.521850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] RBAC: Authorizing `identity:get_user(user_id=98cb2703ac0d45719339d37ff24deaa9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:15.523478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:15.525459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 102/202] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:15 2022] GET /identity/v3/users/98cb2703ac0d45719339d37ff24deaa9 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:15.531192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.554312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:15.643979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e9cd-6fcf-4803-a8c9-f1c3fdac313e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.680564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.681350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.681692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.682025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:15.750936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:15.752461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:15.781456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:15.853542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 101/203] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:15.859438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:15.963358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d9c9-39d3-4442-9147-695966e2d8fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:15.997995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:15.998642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:15.998919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:15.999193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:16.000334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:16.001870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9952d9b-a911-4aa4-ba24-bab9b9b8165a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:16.003473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 103/204] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:15 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:16.009788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:16.109476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9f0a-7373-4727-afc7-5c9f5a8e4d0e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:16.126365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:16.144201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:16.144819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:16.145121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:16.145390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:16.146113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] RBAC: Adding query filter params (role.id=13d7deed477f4bb486fee9fa5d749deb, scope.project.id=16a2c43deb124812862e2ea4601fbf45, user.id=98cb2703ac0d45719339d37ff24deaa9) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:16.146412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:16.147866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473160f-34a5-49ab-b3d7-c6a59a7be3b2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:16.154207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 102/205] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:16 2022] GET /identity/v3/role_assignments?user.id=98cb2703ac0d45719339d37ff24deaa9&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:16.935662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bcb34-64c1-4bde-bc80-56c55bf5b1ee None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:16.936098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bcb34-64c1-4bde-bc80-56c55bf5b1ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:16.936292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bcb34-64c1-4bde-bc80-56c55bf5b1ee None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:16.937751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 104/206] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:16.943819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4005f4-593d-4757-808a-b77766799021 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:16.944148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4005f4-593d-4757-808a-b77766799021 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:16.944341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4005f4-593d-4757-808a-b77766799021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:16.964298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6a4005f4-593d-4757-808a-b77766799021 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:16.965524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a4005f4-593d-4757-808a-b77766799021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:17.036558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 103/207] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:17.048394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2a19-4bf7-4bdd-ac51-0933387b7150 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.048813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2a19-4bf7-4bdd-ac51-0933387b7150 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.049048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2a19-4bf7-4bdd-ac51-0933387b7150 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.050519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 105/208] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:17.055628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.055916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.056190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.074905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:17.076098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:17.143262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 104/209] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:17.302585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf2a19-4bf7-4bdd-ac51-0933387b7150 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.333627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:17.404938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.411576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf2a19-4bf7-4bdd-ac51-0933387b7150 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.445478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.446135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.446412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.446681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.451828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:17.458069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:17.463372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:17.464258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:17.465075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 106/210] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:17.470249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.521839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc8cb-9542-4874-b1b1-f7d2c017066b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.564726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:17.566157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.566861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.567177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.567450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.569116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:17.570586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:17.572509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 105/211] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:17.577693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea28a-3cca-4001-879a-2347fcd8c798 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.577843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.614988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.615625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.615888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.616170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.616826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:17.617149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:17.618545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c36be-ab76-49ec-ad4b-d77bf8ab10f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:17.626352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 107/212] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:17.627465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13637-8049-40d0-a18d-a05f1b4da9dd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.627738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13637-8049-40d0-a18d-a05f1b4da9dd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.628000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e13637-8049-40d0-a18d-a05f1b4da9dd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.629361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 108/213] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:17.634741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e13637-8049-40d0-a18d-a05f1b4da9dd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.678432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2660-6a56-4a6b-8974-61d4949431e2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.687474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:17.712595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.713340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.713603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.713873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.714543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:17.715988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e3602-ce5d-4017-a9cc-51c01558bd28 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:17.736177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e13637-8049-40d0-a18d-a05f1b4da9dd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.737662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 106/214] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:17 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:29:17.738845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.739127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.739394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.758202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:17.759520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:17.784768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.785454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.785725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.785991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] PATH_INFO: `/v3/users/599453524c164afd83a0e90e44023589` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.801344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] RBAC: Authorizing `identity:get_user(user_id=599453524c164afd83a0e90e44023589)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:17.802988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:17.805150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 109/215] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:17 2022] GET /identity/v3/users/599453524c164afd83a0e90e44023589 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:17.811003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:17.823310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:17.838827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 107/216] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:17.925403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736e953-fa48-4a14-b90f-dbf17e8716dc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:17.960302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:17.960912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:17.961217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:17.961512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:17.962277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] RBAC: Adding query filter params (role.id=13d7deed477f4bb486fee9fa5d749deb, user.id=599453524c164afd83a0e90e44023589, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:17.962580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:17.964027 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:17.969113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 110/217] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 11 06:29:17 2022] GET /identity/v3/role_assignments?user.id=599453524c164afd83a0e90e44023589&scope.system=all&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:18.100315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:18.197323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:18.204199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5de33e-868b-4e34-8168-b08707c401ae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:18.240904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:18.241665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:18.241938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:18.242206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:18.252944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:18.257881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:18.258773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:18.259578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 108/218] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:18.264889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:18.337562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:18.368098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704c246-b6b0-4d58-82f4-fc7838ac2591 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:18.406830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:18.407448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:18.407712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:18.407978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:18.408632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:18.408922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:18.410364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:18.419152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 111/219] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:18.425071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:18.530502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d690dd-7c7a-44fc-8a73-12bd8268e438 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:18.571231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:18.572129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:18.572597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:18.573118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] PATH_INFO: `/v3/users/505c1b6685bd41f7b581d87c6f73118a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:18.574531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] RBAC: Authorizing `identity:get_user(user_id=505c1b6685bd41f7b581d87c6f73118a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:18.576258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:18.578104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 109/220] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:18 2022] GET /identity/v3/users/505c1b6685bd41f7b581d87c6f73118a => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:18.585056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:18.687975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516d92-b91c-4aff-a349-c0cb3edf7b76 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:18.725783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:18.726463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:18.726740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:18.727006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:18.729761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:18.797747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:18.799280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:18.906933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 112/221] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:18.914082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:18.941097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:19.017400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dbbe5-368e-4492-ba49-16942c2d06f5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:19.050595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:19.051229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:19.051502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:19.051768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:19.052888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:19.054375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29b112-ed52-4f8e-85be-5ddc49af9566 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:19.056354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 110/222] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:18 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:19.062196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:19.095929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:19.166543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcac780-f1ac-4fa4-9e21-ce886a370c18 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:19.202678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:19.203208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:19.203478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:19.203740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:19.204460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] RBAC: Adding query filter params (role.id=1ac1afa9131b4b24bdcc13e8fed36811, scope.project.id=16a2c43deb124812862e2ea4601fbf45, user.id=505c1b6685bd41f7b581d87c6f73118a) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:19.204756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:19.206230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205da1a-a777-476d-b5e5-f8dd6fb3b4c2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:19.213025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 113/223] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:19 2022] GET /identity/v3/role_assignments?user.id=505c1b6685bd41f7b581d87c6f73118a&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=1ac1afa9131b4b24bdcc13e8fed36811 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:20.101439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bd1-8fee-4015-acfd-eb491d4ec9c0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.101990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bd1-8fee-4015-acfd-eb491d4ec9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.101990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8bd1-8fee-4015-acfd-eb491d4ec9c0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.103378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 111/224] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:20.104019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1462-0dc6-4289-b4de-ebfed586195a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.104417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1462-0dc6-4289-b4de-ebfed586195a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.104568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1462-0dc6-4289-b4de-ebfed586195a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.106085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 114/225] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:20.108497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b984c-6546-4b29-a9da-cf2886e8c630 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.108777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b984c-6546-4b29-a9da-cf2886e8c630 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.109036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b984c-6546-4b29-a9da-cf2886e8c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.111481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.111730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.111995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.127867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cb0b984c-6546-4b29-a9da-cf2886e8c630 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:20.129097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb0b984c-6546-4b29-a9da-cf2886e8c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:20.129915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:20.131053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:20.197994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 112/226] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:20.199318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e37b-2632-43da-9b8e-afabe3e425bf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.199588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e37b-2632-43da-9b8e-afabe3e425bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.199777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e37b-2632-43da-9b8e-afabe3e425bf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.201172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 113/227] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:20.201573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 115/228] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:20.206177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.206811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.207093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.224950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:20.226244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:20.241233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.293546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 114/229] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:20.461746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.462172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.493683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.569197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a237005-0c8e-4bd0-95c3-9a09ed9cc23b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.572857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e03b8a-da0c-403f-9b43-b08ae5412854 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.603438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.604083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.604354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.604623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.606087 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.606884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.607427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.607700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.608792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:20.610281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:20.611862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 116/230] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:20.612609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.614801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:20.619965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:20.620931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:20.621738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 115/231] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:20.622391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.634500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.704703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.712284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4524666-8c53-4620-835a-1ada80fc9fb1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.723584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e1aab-e978-45a1-b73a-0b4b42dd78d8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.748375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.749028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.749337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.749606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.758296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.758979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.759250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.759509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] PATH_INFO: `/v3/groups` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.759666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:20.760137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:20.761634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:20.764921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:20.765828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:20.766606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 117/232] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:20.768395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.777808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 116/233] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Oct 11 06:29:20 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:20.778725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.869451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.884450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46638897-59c1-484f-bb5c-357a86943545 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.904410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e33fa4-ea0b-4c3c-ba90-b60a6bd8584f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:20.921549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.922180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.922455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.922718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.923402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:20.923690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:20.925123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:20.934168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 118/234] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:20.940097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:20.947099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:20.947737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:20.948014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:20.948287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:20.948970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:20.949305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:20.950718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:20.960971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 117/235] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:20.961607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:20.966949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:21.049167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a184b5b-7633-463a-a9d9-de5a9cc45641 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:21.081115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057ae2-1197-4df2-a18e-b4c94d79ef2b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:21.082506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:21.083146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:21.083414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:21.083669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] PATH_INFO: `/v3/users/0a0ce8e162984c84bd1fb29eb97e0548` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:21.096877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0ce8e162984c84bd1fb29eb97e0548)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:21.098407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:21.100070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 119/236] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/users/0a0ce8e162984c84bd1fb29eb97e0548 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:21.106427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:21.117473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:21.125518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:21.126169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:21.126443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:21.126706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] PATH_INFO: `/v3/users/599453524c164afd83a0e90e44023589` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:21.127839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] RBAC: Authorizing `identity:get_user(user_id=599453524c164afd83a0e90e44023589)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:21.129442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:21.131437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 118/237] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:20 2022] GET /identity/v3/users/599453524c164afd83a0e90e44023589 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:21.136874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:21.184195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:21.207240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fac2c-529e-43f8-b1be-e977d27633f0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:21.241581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:21.242110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:21.242384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:21.242678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:21.243246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdb269-d9ea-4efa-97d8-cc08a0151b97 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:21.243431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] RBAC: Adding query filter params (role.id=1ac1afa9131b4b24bdcc13e8fed36811, user.id=0a0ce8e162984c84bd1fb29eb97e0548, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:21.243732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:21.245192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefce8ed-2e14-4379-946f-f358b6bd91cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:21.261192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 120/238] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 11 06:29:21 2022] GET /identity/v3/role_assignments?user.id=0a0ce8e162984c84bd1fb29eb97e0548&scope.system=all&role.id=1ac1afa9131b4b24bdcc13e8fed36811 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:21.292760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:21.293469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:21.293747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:21.294022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] PATH_INFO: `/v3/system/users/599453524c164afd83a0e90e44023589/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:21.295500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=599453524c164afd83a0e90e44023589, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:21.296903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078378cf-c836-4818-9494-b8b0f35ce6b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:21.308546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 119/239] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Oct 11 06:29:21 2022] PUT /identity/v3/system/users/599453524c164afd83a0e90e44023589/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:29:22.945025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014ea2-d158-44df-86ea-9b81e0a20691 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:22.945583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014ea2-d158-44df-86ea-9b81e0a20691 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:22.945583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014ea2-d158-44df-86ea-9b81e0a20691 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:22.947052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 121/240] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:22.952565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8769-59c7-4f89-9a29-d9f1b532adb3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:22.952992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8769-59c7-4f89-9a29-d9f1b532adb3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:22.952992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8769-59c7-4f89-9a29-d9f1b532adb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:22.972033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cc8b8769-59c7-4f89-9a29-d9f1b532adb3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:22.973271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cc8b8769-59c7-4f89-9a29-d9f1b532adb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:23.033310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:23.044348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 120/241] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:23.305561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014ea2-d158-44df-86ea-9b81e0a20691 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:23.387181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a4ce-5a0b-4c20-8a68-44ad17919aa0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.387513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a4ce-5a0b-4c20-8a68-44ad17919aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.387711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a4ce-5a0b-4c20-8a68-44ad17919aa0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.389240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 121/242] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:23.393937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259e26-59fd-4932-82fb-f1298ef2e2a8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.394211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259e26-59fd-4932-82fb-f1298ef2e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.394476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259e26-59fd-4932-82fb-f1298ef2e2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.412802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-16259e26-59fd-4932-82fb-f1298ef2e2a8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:23.413998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-16259e26-59fd-4932-82fb-f1298ef2e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:23.417521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014ea2-d158-44df-86ea-9b81e0a20691 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:23.454448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:23.455092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.455354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.455614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.457108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:23.458547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be7bb9-bc2c-4717-85ef-a684af08179c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:23.460115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 122/243] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:23.461386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efc8f-b3a6-4892-a2c5-5da3c1479fb4 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.461708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efc8f-b3a6-4892-a2c5-5da3c1479fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.461975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efc8f-b3a6-4892-a2c5-5da3c1479fb4 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.463266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 123/244] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:23.465845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9efc8f-b3a6-4892-a2c5-5da3c1479fb4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:23.476676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:23.481850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 122/245] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:23.483235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.483476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.483685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.504951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:23.506407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:23.575275 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9efc8f-b3a6-4892-a2c5-5da3c1479fb4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:23.579551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 123/246] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:23.611514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:23.612136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.612402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.612669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] PATH_INFO: `/v3/groups` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.613331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:23.614836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:23.637034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 124/247] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Oct 11 06:29:23 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:23.741647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:23.801381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:23.846426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:23.848842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5595c-1db4-48fb-a8ba-303ebae52e58 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:23.885638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:23.886284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:23.886548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:23.886821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:23.897341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:23.902573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:23.903447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:23.904232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 124/248] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:23.913587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:23.934184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:23.977465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd95fa-4b7d-43c5-9da9-ebe45e7a0d23 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.022561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.023212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.023487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.023756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.035035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9e4c6-5022-4bf7-b4f3-f7c2b8d2fb26 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.036493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:24.041926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:24.043011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:24.043776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 125/249] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:24.054569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:24.058048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:24.081206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.082181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.082750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.082750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.083415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:24.083711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.085186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.095530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 125/250] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:24.101367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:24.183060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59241bb-b17a-4316-b864-c81de5d945be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.219184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:24.222049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9b2a-02ab-4142-a0a8-89ff8944aa27 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.227991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.228882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.229375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.229854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.231114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:24.231612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.234002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.245247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 126/251] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:24.251808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:24.265199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.265860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.266137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.266408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] PATH_INFO: `/v3/users/0a0ce8e162984c84bd1fb29eb97e0548` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.267722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0ce8e162984c84bd1fb29eb97e0548)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.269307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.271449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 126/252] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:24 2022] GET /identity/v3/users/0a0ce8e162984c84bd1fb29eb97e0548 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:24.277197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:24.336176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:24.390301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be83b5e-0c59-49c8-ba65-6a146f8e867f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.397912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09b11-1294-418b-b4d7-d2d0bfabd1e8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.437046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.438163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.438714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.439189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] PATH_INFO: `/v3/users/599453524c164afd83a0e90e44023589` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.440246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.440749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] RBAC: Authorizing `identity:get_user(user_id=599453524c164afd83a0e90e44023589)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.440932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.441342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.441610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] PATH_INFO: `/v3/system/users/0a0ce8e162984c84bd1fb29eb97e0548/roles/1ac1afa9131b4b24bdcc13e8fed36811` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.443017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a0ce8e162984c84bd1fb29eb97e0548, role_id=1ac1afa9131b4b24bdcc13e8fed36811)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.443213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.444399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1a4e-378d-425e-ac6b-3f52376f8a44 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.445509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 127/253] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:24 2022] GET /identity/v3/users/599453524c164afd83a0e90e44023589 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:24.453638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:24.460624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 127/254] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Oct 11 06:29:24 2022] PUT /identity/v3/system/users/0a0ce8e162984c84bd1fb29eb97e0548/roles/1ac1afa9131b4b24bdcc13e8fed36811 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:24.542241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:24.606504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63300ac-67e4-40be-afe4-3d8bb5f7c652 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:24.649127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:24.649747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:24.650027 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:24.650372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:24.651251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] RBAC: Adding query filter params (role.id=13d7deed477f4bb486fee9fa5d749deb, user.id=599453524c164afd83a0e90e44023589, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:24.651611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:24.653132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806fa6f-5c61-472e-b4e2-6f89c8b870d5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:24.674334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 128/255] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 11 06:29:24 2022] GET /identity/v3/role_assignments?user.id=599453524c164afd83a0e90e44023589&scope.system=all&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:26.153616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07385-2962-4908-9c6f-a3979d0bc12c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.154177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07385-2962-4908-9c6f-a3979d0bc12c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.154177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07385-2962-4908-9c6f-a3979d0bc12c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.155744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 128/256] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:26.161893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619804-23f4-432a-91a4-a10ba0d34d94 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.163440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619804-23f4-432a-91a4-a10ba0d34d94 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.163440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619804-23f4-432a-91a4-a10ba0d34d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.185657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bb619804-23f4-432a-91a4-a10ba0d34d94 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:26.187244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb619804-23f4-432a-91a4-a10ba0d34d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:26.253510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 129/257] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:29:26.278549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3bba-207a-4fa3-8cd9-15edf6730e8f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.279172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3bba-207a-4fa3-8cd9-15edf6730e8f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.279669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3bba-207a-4fa3-8cd9-15edf6730e8f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.281284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 129/258] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:26.286664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.286947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.287219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.310378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:26.311908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:26.321882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 130/259] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:29:26.547080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3bba-207a-4fa3-8cd9-15edf6730e8f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.565676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3bba-207a-4fa3-8cd9-15edf6730e8f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.570125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.570896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.573917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.573917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.593632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:26.598541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:26.599395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:26.600202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 130/260] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:26.605956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.619284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dc441-0b4e-4d6e-a10a-1c6adccd24fb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.629253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.630148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.630620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.631083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.631984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:26.632478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:26.634602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:26.634602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:29:26.634602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:29:26.635923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:26.651911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 131/261] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:26.657274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.670358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4529-dade-47c1-b30d-dec2a22addfd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.676098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.676792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.677101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.677375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.687419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:26.689539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:26.689539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:29:26.689539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:29:26.691129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:26.693331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 131/262] 10.222.0.30 () {56 vars in 1201 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:26.698718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.714286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73520696-478b-4613-9fb5-11ae8a4507dd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.719172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.720071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.720544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.721043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.725743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:26.728283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:26.730243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 132/263] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:26.736114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.748904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e981c-fc3b-44ea-a747-3f1ac0f57f48 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.754260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.755267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.755774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.756287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/groups/2ad173b6e1ee448c97178e359cb4712d/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.758711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, group_id=2ad173b6e1ee448c97178e359cb4712d, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:26.760005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:26.760005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:29:26.760005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:29:26.762414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:26.793582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 132/264] 10.222.0.30 () {58 vars in 1463 bytes} [Tue Oct 11 06:29:26 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/groups/2ad173b6e1ee448c97178e359cb4712d/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:26.859011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:26.874540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f874ec-3767-4917-baba-8197ca90740d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:26.937425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:26.954665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:26.955308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:26.955578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:26.955843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:26.974596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:26.979635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:26.980496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:26.981337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:26.982070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 133/265] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:26.987365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:27.005907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db60793-1e9a-44d8-9279-c4b395297116 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:27.022404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:27.023062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.023336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.023602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.024379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:27.024678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:27.025778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:27.025778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:29:27.025778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:29:27.026679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:27.036405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 133/266] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 11 06:29:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:27.042949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:27.059164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e118f5-cab6-4a23-a86d-09974d842930 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:27.069252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:27.069904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.070173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.070437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.073793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:27.074880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:27.074880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:29:27.074880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:29:27.076124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:27.077863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 134/267] 10.222.0.30 () {56 vars in 1201 bytes} [Tue Oct 11 06:29:27 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:27.083963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:27.098747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afe1d4-5cbe-4a26-a2da-d992f22bc2a8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:27.106541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:27.107237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.107510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.107780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.109172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:27.111281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796311-6f71-43eb-8fda-2e82fd5a7efa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:27.113117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 134/268] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:29:27 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:27.119367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:27.135142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd19e8-4d60-40b6-b4b9-54d69a80dee3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:27.144302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:27.145062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.145337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.145606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b/groups/2ad173b6e1ee448c97178e359cb4712d/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.148006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c96055ce3742879e28dbd6c951d83b, group_id=2ad173b6e1ee448c97178e359cb4712d, role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:27.149169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:29:27.149169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:29:27.149169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:29:27.151359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e241ae-9a62-4588-b996-33ed80f88bfe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:27.185153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 135/269] 10.222.0.30 () {58 vars in 1463 bytes} [Tue Oct 11 06:29:27 2022] PUT /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b/groups/2ad173b6e1ee448c97178e359cb4712d/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:27.253823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97b79-f125-4655-95e9-2816b026d259 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.254501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97b79-f125-4655-95e9-2816b026d259 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.254501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b97b79-f125-4655-95e9-2816b026d259 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.256003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 135/270] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:27.262336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551b7b-1ef9-491a-b0a4-84903a81b541 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.262940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551b7b-1ef9-491a-b0a4-84903a81b541 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.263469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551b7b-1ef9-491a-b0a4-84903a81b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.290950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b4551b7b-1ef9-491a-b0a4-84903a81b541 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:27.292532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4551b7b-1ef9-491a-b0a4-84903a81b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:27.387105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 136/271] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:27.535772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4127-d84d-4b27-a55b-2dc3bb1abe3e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.536053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4127-d84d-4b27-a55b-2dc3bb1abe3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.536517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4127-d84d-4b27-a55b-2dc3bb1abe3e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.538037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 136/272] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:27.543614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:27.543892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:27.544161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:27.572096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:27.572096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:27.658832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 137/273] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:29:27.867178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae4127-d84d-4b27-a55b-2dc3bb1abe3e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:27.945574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:27.993922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae4127-d84d-4b27-a55b-2dc3bb1abe3e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.030109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.030764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.031306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.031578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.042372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:28.047764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:28.048628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:28.049435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 137/274] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:28.054952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.095769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.113343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490729-de60-42b8-819a-8e2ca65b30c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.130120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.130771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.131052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.131319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.140576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:28.153290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:28.158877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:28.159735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:28.160496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 138/275] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:28.174780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.188482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb650-d3ad-4456-b655-a44e43b05352 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.197838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.198398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.198663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.198923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.199595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:28.199889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.201568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.226169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 139/276] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:28.250068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f1ea7-aaf1-4564-a50c-39a14cbbecd3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.261367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.271657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0b15f-79c5-4123-8d96-3b8adce93d73 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.280132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.280768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.281064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.281487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.282740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.286346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.293023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 140/277] 10.222.0.30 () {56 vars in 1201 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:28.298215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.313558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bac5d8-81ea-4f1a-a1e2-352430c642ec admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.321540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.322457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.322919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.323371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.324228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:28.324992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.325556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.326372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.327948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.328411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.328864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.332113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.334351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.336441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 141/278] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:28.347671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 138/279] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:28.353737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.360145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.374989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cb6cf-fbe0-4571-aeee-99ec2d914959 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.387953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.388628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.388906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.389196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/groups/2ad173b6e1ee448c97178e359cb4712d/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.392181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, group_id=2ad173b6e1ee448c97178e359cb4712d, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.394874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.423406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 139/280] 10.222.0.30 () {58 vars in 1463 bytes} [Tue Oct 11 06:29:28 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/groups/2ad173b6e1ee448c97178e359cb4712d/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:28.494923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:28.505699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132697-9441-4d0d-b29f-77201c1cee04 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.547048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.547699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.547968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.548233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] PATH_INFO: `/v3/users/0a0ce8e162984c84bd1fb29eb97e0548` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.549428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] RBAC: Authorizing `identity:get_user(user_id=0a0ce8e162984c84bd1fb29eb97e0548)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.551034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7e3a2-6e68-4841-8b49-ea120320cb3d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.557197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 142/281] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/users/0a0ce8e162984c84bd1fb29eb97e0548 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:28.559358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:28.679497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:28.692498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f719e25-15fa-449f-b5d7-3b5fd171403a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:28.740623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:28.741315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.741593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.741906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.742773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] RBAC: Adding query filter params (role.id=1ac1afa9131b4b24bdcc13e8fed36811, user.id=0a0ce8e162984c84bd1fb29eb97e0548, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:28.743081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:28.744671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17878c50-d4b0-4800-8561-05062e9bb541 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:28.763855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 140/282] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 11 06:29:28 2022] GET /identity/v3/role_assignments?user.id=0a0ce8e162984c84bd1fb29eb97e0548&scope.system=all&role.id=1ac1afa9131b4b24bdcc13e8fed36811 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:28.959694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b0aa-ef8a-4b19-9a62-ea8bc3b45884 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.959995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b0aa-ef8a-4b19-9a62-ea8bc3b45884 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.960259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b0aa-ef8a-4b19-9a62-ea8bc3b45884 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.961953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 143/283] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:28.967029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cb78-5838-48a2-802c-a136c4645720 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:28.967577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cb78-5838-48a2-802c-a136c4645720 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:28.968075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32cb78-5838-48a2-802c-a136c4645720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:28.992272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3e32cb78-5838-48a2-802c-a136c4645720 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:28.993887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e32cb78-5838-48a2-802c-a136c4645720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:29.058855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 141/284] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:29:29.605474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2442-8072-46b7-8fba-ff384a3c1bd0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.606452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2442-8072-46b7-8fba-ff384a3c1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.606921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf2442-8072-46b7-8fba-ff384a3c1bd0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.608719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 144/285] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:29.614770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.615613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.616095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.625027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf2442-8072-46b7-8fba-ff384a3c1bd0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:29.644658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf2442-8072-46b7-8fba-ff384a3c1bd0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:29.647909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:29.649428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:29.655874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:29.655874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.655874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.655874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.665411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 142/286] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 06:29:29.685968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:29.690875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:29.691740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:29.692738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 145/287] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:29:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:29.698123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:29.714165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab566856-ae46-419b-962e-4353a7b4c335 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:29.722124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:29.722735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.723009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.723276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.723947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:29.724236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:29.725853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:29.739183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 143/288] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 11 06:29:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:29.744831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:29.758365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991024-d3d3-4497-9861-84298acd937f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:29.766148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:29.766796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.767066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.767337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.768476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:29.770420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:29.771981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 146/289] 10.222.0.30 () {56 vars in 1201 bytes} [Tue Oct 11 06:29:29 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:29.777621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:29.790183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7322-5ebf-4acc-b3e7-35c864117d82 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:29.794786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:29.795426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.795701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.795967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.801716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:29.803786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aeb6c2-53ed-4bc1-b1c9-fd32247e456b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:29.805518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 144/290] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:29:29 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:29.811250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:29.821896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba241-bc2d-40fb-92c3-3779ec7aa5ee admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:29.826499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:29.827201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.827472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.827742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45/groups/2ad173b6e1ee448c97178e359cb4712d/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.830136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a2c43deb124812862e2ea4601fbf45, group_id=2ad173b6e1ee448c97178e359cb4712d, role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:29.833268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7405e2-8321-4dde-9aa7-e019361b54e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:29.863770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 147/291] 10.222.0.30 () {58 vars in 1463 bytes} [Tue Oct 11 06:29:29 2022] PUT /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45/groups/2ad173b6e1ee448c97178e359cb4712d/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:29.966954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719c95-a646-447e-868f-f78ecacd9f60 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.967309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719c95-a646-447e-868f-f78ecacd9f60 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.967524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719c95-a646-447e-868f-f78ecacd9f60 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.969139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 145/292] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:29.974805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:29.975080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:29.975409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:29.998755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:29.999948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:30.085357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 148/293] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:30.135472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719c95-a646-447e-868f-f78ecacd9f60 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.211892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719c95-a646-447e-868f-f78ecacd9f60 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.216637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.217329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.217602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.217869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.230418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:30.236240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:30.237209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:30.238483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 146/294] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:30.243964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.254857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfc654-5c0b-4b78-862a-39c5584d13db None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.259586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.260268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.260545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.260811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.261533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:30.261835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:30.263493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:30.273034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 149/295] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:30.279459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.290005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c09c5-6fd3-41bd-afc0-e3cf04cba113 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.295224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.295937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.296211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.296527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] PATH_INFO: `/v3/groups/dc000e43b8954459bce4ee5e429af182` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.303451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] RBAC: Authorizing `identity:get_group(group_id=dc000e43b8954459bce4ee5e429af182)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:30.305536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:30.307532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 147/296] 10.222.0.30 () {56 vars in 1201 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/groups/dc000e43b8954459bce4ee5e429af182 => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:30.313127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.324219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af270e9a-74f4-4357-89af-5e88f4f03973 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.328905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.329636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.329907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.330180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] PATH_INFO: `/v3/projects/0d5a17a08f1b4f70b45357309fc45101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.331972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d5a17a08f1b4f70b45357309fc45101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:30.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a798d16-7712-4533-8743-25d5f3235378 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:30.335941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 150/297] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/projects/0d5a17a08f1b4f70b45357309fc45101 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:30.341627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.346774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18276-755c-4a01-abd4-71cdb42455ea None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.347061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18276-755c-4a01-abd4-71cdb42455ea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.347329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b18276-755c-4a01-abd4-71cdb42455ea None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.348798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 151/298] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:30.354167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250afdde-71a5-4415-bbab-d59d8360c11d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.355173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.355457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.355725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.359620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.360556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.361098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.361536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] PATH_INFO: `/v3/projects/0d5a17a08f1b4f70b45357309fc45101/groups/dc000e43b8954459bce4ee5e429af182/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.363732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5a17a08f1b4f70b45357309fc45101, group_id=dc000e43b8954459bce4ee5e429af182, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:30.366870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:30.370691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:30.384715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:30.385952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:30.386931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 148/299] 10.222.0.30 () {58 vars in 1463 bytes} [Tue Oct 11 06:29:30 2022] PUT /identity/v3/projects/0d5a17a08f1b4f70b45357309fc45101/groups/dc000e43b8954459bce4ee5e429af182/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:30.479317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.482192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:30.513774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 152/300] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:30.671202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76880d-cec1-46de-a86a-69a1943ed98d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.714366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.714997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.715269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.715536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.726327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:30.731718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:30.732587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:30.734166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 149/301] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:30.738793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.845184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34251009-b078-4f80-a880-3acc2d92bc0d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:30.846570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.883527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:30.884146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:30.884419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:30.884683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:30.885372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:30.885666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:30.887135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:30.896230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 153/302] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:30.902072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:30.912930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:30.952534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:30.964658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721631f-3b93-4156-bd7d-823b7031656f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.003016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.003661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.003934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.004200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.016867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:31.020129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceaf0e-1f7c-4b81-b1fd-30bb3b7c88b3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:31.022729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:31.023611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:31.024466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 150/303] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:31.033988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.079297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.080376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.080840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.081782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.140660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e935-a7a7-4abd-a65b-f8d93c75d48c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.158250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:31.178821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.179436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.179707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.180013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.180684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:31.180977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:31.182403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:31.198173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:31.199649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:31.203484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 151/304] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:31.209691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.285108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:31.398034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5fdf7-ed3e-49f9-8c4a-a14394f994b1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.404517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 154/305] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 06:29:31.429563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.460806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.461476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.461752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.462018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.545564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:31.570004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:31.571683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:31.621511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8973e11-7381-4cd2-8e55-1cf42aab1c7c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.680015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 152/306] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 06:29:31.685519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.686060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.686924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.687391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.687857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.693692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:31.695380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:31.697619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 155/307] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:31.722191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.741411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:31.777026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:31.798268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5711c7-6c85-4450-8900-49f202012d27 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.836572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.837242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.837571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.837841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] PATH_INFO: `/v3/projects/e9c96055ce3742879e28dbd6c951d83b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:31.839417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] RBAC: Authorizing `identity:get_project(project_id=e9c96055ce3742879e28dbd6c951d83b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:31.841207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:31.843259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 153/308] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/projects/e9c96055ce3742879e28dbd6c951d83b => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:31.849562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:31.961390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9714a2-2710-4bbb-a8c4-10803eb0b8dc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.962538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67e955-8931-4d07-b23e-6d05c39b6704 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:31.998319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:31.998929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:31.999206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:31.999474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.000595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:32.005023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:32.005023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 154/309] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:32.009836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:32.017259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:32.017920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.018193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.018462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.019595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:32.021084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:32.027440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:32.029440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 156/310] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 11 06:29:31 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:32.042076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:32.121534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bba2d7-9312-4962-82f8-61e135408596 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:32.149544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:32.161799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:32.162730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.163144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.163549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.164504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] RBAC: Adding query filter params (group.id=2ad173b6e1ee448c97178e359cb4712d, role.id=2fe08520986d4aa7bb1cb6e78c716101, scope.project.id=e9c96055ce3742879e28dbd6c951d83b) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:32.164944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:32.166767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67fc6c-4617-4075-8da5-904cd3fe7446 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:32.174502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 155/311] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 11 06:29:32 2022] GET /identity/v3/role_assignments?group.id=2ad173b6e1ee448c97178e359cb4712d&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=2fe08520986d4aa7bb1cb6e78c716101 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:32.174650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e135e2b-59d8-499a-b68f-9f97238c6ae0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:32.176146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e6c11-5b2b-404c-b5c7-74728d5a39f7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.176563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e6c11-5b2b-404c-b5c7-74728d5a39f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.181185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e6c11-5b2b-404c-b5c7-74728d5a39f7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.183001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 156/312] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:32.188743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.189299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.189725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.218353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:32.219876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:32.228405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:32.229042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.229322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.229612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.230335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] RBAC: Adding query filter params (group.id=2ad173b6e1ee448c97178e359cb4712d, role.id=13d7deed477f4bb486fee9fa5d749deb, scope.project.id=e9c96055ce3742879e28dbd6c951d83b) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:32.230619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:32.232065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:32.245900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 157/313] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 11 06:29:32 2022] GET /identity/v3/role_assignments?group.id=2ad173b6e1ee448c97178e359cb4712d&scope.project.id=e9c96055ce3742879e28dbd6c951d83b&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:32.328079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 157/314] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:32.616736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:32.741718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16180eb1-7cc6-41bd-981f-4d314c64a678 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:32.785282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:32.786240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.786510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.786774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.794812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:32.799030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e780c86a-d073-4ba5-830c-14a07300eaf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:32.804220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:32.805324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 06:29:32.806277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:32.808869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 158/315] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:32.815172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:32.831939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:32.855113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1186ac-406f-458f-9170-99cb5ae3f522 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.855302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1186ac-406f-458f-9170-99cb5ae3f522 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.855557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1186ac-406f-458f-9170-99cb5ae3f522 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.856931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 159/316] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:32.862632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c128-2312-4a83-b370-60528649245c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.863085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c128-2312-4a83-b370-60528649245c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.863485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01c128-2312-4a83-b370-60528649245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.890074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dd01c128-2312-4a83-b370-60528649245c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:32.891271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd01c128-2312-4a83-b370-60528649245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:32.946756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3b921-7021-407f-8b8a-9d3842e469de None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:32.981499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 160/317] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:32.993280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:32.994253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:32.994729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:32.995182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:32.996032 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:32.996532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:32.998142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74ae8e-90ed-4b1b-a1c5-e47f7fbb8dfc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.007362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 158/318] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:33.013390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01c128-2312-4a83-b370-60528649245c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.052151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6b86-14ea-444d-8dbc-120ba3291e53 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.052464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6b86-14ea-444d-8dbc-120ba3291e53 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.052698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e6b86-14ea-444d-8dbc-120ba3291e53 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.054325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 159/319] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:33.060490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.060767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.061078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.082132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:33.083647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:33.121309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01c128-2312-4a83-b370-60528649245c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.153491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.155649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.160296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.160516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 160/320] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:33.160918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.161226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.161492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.238450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:33.239920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.256549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.358555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 161/321] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:33.364884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.378139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1570d-45c6-49a8-8e0c-5f10c61a66ca None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.404847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.430835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.431476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.431743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.432001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.443846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:33.450053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:33.450915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:33.451856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 161/322] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:33.452505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.495944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71631a52-bcb5-4bd9-a733-51a7767bdb8d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.517393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.541404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.542220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.542498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.542765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.544347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:33.546122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.549641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 162/323] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:33.549641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.565523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4628-05f3-47cc-835e-d7b52f0b450a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.606101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.606742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.607049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.607276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.617633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:33.622443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:33.623338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:33.624174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 162/324] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:33.624810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.680407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.684218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0e1b1-9680-44f4-9d52-ccefbf93c25f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.724308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.724919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.725229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.725493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.726149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:33.726442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:33.727841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.736233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 163/325] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:33.736949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.740680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e8007-30b3-49c4-b129-16aee23f58fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.763702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.781959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.782630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.782900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.783167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.784280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:33.785780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.788222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 163/326] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:33.788822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.847829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14b417-d5b0-48c5-817c-832f5471b2d0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.887876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.888740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.889216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.889624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.890451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:33.890888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:33.892389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:33.901135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c65ef-3fb4-4cff-ad2d-b4970e45cc98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:33.901604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 164/327] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:33.902834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:33.932516 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:33.944466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:33.945123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:33.945399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:33.945697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:33.998403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.008754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cd7b4-c35c-43bf-906d-42ad0949d2b7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.010964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.012504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.042890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.043500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.043767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.044033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.044748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] RBAC: Adding query filter params (group.id=2ad173b6e1ee448c97178e359cb4712d, role.id=13d7deed477f4bb486fee9fa5d749deb, scope.project.id=16a2c43deb124812862e2ea4601fbf45) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:34.045083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.046491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.052487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 165/328] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/role_assignments?group.id=2ad173b6e1ee448c97178e359cb4712d&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=13d7deed477f4bb486fee9fa5d749deb => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:34.059798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.132316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 164/329] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:34.138349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.152839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.170096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c036b32-febb-4147-9fc9-c84e99bcc22c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.207075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.207612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.207885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.208149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.240336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.257888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36e87-4d39-4ea3-bdc0-6596672512f8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.287355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.288798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.297445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.298089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.298364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.301520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] PATH_INFO: `/v3/projects/16a2c43deb124812862e2ea4601fbf45` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.302128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] RBAC: Authorizing `identity:get_project(project_id=16a2c43deb124812862e2ea4601fbf45)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.303556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.306285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 165/330] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/projects/16a2c43deb124812862e2ea4601fbf45 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:34.313132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.384437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.400461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 166/331] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:34.406056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.433477 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86b3fd-927e-41ef-91b5-1ef415e32074 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.468208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.468774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.469069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.469340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] PATH_INFO: `/v3/groups/2ad173b6e1ee448c97178e359cb4712d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.470433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] RBAC: Authorizing `identity:get_group(group_id=2ad173b6e1ee448c97178e359cb4712d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.471890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.473500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 166/332] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/groups/2ad173b6e1ee448c97178e359cb4712d => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:34.479279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.503371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.506515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0df5e9-dd0a-4cef-874c-d22ce85ed36d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.542999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.543623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.543891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.544153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] PATH_INFO: `/v3/projects/0d5a17a08f1b4f70b45357309fc45101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.545300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] RBAC: Authorizing `identity:get_project(project_id=0d5a17a08f1b4f70b45357309fc45101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.546738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.552810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 167/333] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/projects/0d5a17a08f1b4f70b45357309fc45101 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:34.553811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.580888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1ec4a-f3eb-48b3-a401-4539854b7bf7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.610919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.616508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.617169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.617564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.617837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.618569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] RBAC: Adding query filter params (group.id=2ad173b6e1ee448c97178e359cb4712d, role.id=2fe08520986d4aa7bb1cb6e78c716101, scope.project.id=16a2c43deb124812862e2ea4601fbf45) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:34.618870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.620331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.626190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 167/334] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/role_assignments?group.id=2ad173b6e1ee448c97178e359cb4712d&scope.project.id=16a2c43deb124812862e2ea4601fbf45&role.id=2fe08520986d4aa7bb1cb6e78c716101 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:34.659178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78861b-6454-491e-a341-83d5a772a444 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.697432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.698080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.698351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.698614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] PATH_INFO: `/v3/groups/dc000e43b8954459bce4ee5e429af182` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.699816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] RBAC: Authorizing `identity:get_group(group_id=dc000e43b8954459bce4ee5e429af182)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.701335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de7daf-0e1a-44ce-bc43-c21cb157154c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.703008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 168/335] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/groups/dc000e43b8954459bce4ee5e429af182 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:34.709786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:34.807536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:34.819372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7315ef-5e90-43b5-a4ff-ed3f62450972 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:34.853449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:34.854076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:34.854350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:34.854617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:34.855329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] RBAC: Adding query filter params (group.id=dc000e43b8954459bce4ee5e429af182, role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=0d5a17a08f1b4f70b45357309fc45101) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:34.855622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:34.857077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe58e55-4328-46c3-9f0e-0b979eceb41f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:34.863103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 168/336] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 11 06:29:34 2022] GET /identity/v3/role_assignments?group.id=dc000e43b8954459bce4ee5e429af182&scope.project.id=0d5a17a08f1b4f70b45357309fc45101&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:37.361803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d335-2e63-4174-bdca-b8af9444c58b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.362872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d335-2e63-4174-bdca-b8af9444c58b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.363357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1d335-2e63-4174-bdca-b8af9444c58b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.365219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 169/337] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:37.370339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399ac8-7cf5-408c-8905-f08abfdd5634 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.370784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399ac8-7cf5-408c-8905-f08abfdd5634 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.370866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399ac8-7cf5-408c-8905-f08abfdd5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.396779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a9399ac8-7cf5-408c-8905-f08abfdd5634 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:37.398028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a9399ac8-7cf5-408c-8905-f08abfdd5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:37.485481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 169/338] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:37.693738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d811d5-4b01-411f-b9e2-8cef36d0b32d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.694094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d811d5-4b01-411f-b9e2-8cef36d0b32d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.694269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d811d5-4b01-411f-b9e2-8cef36d0b32d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.696104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 170/339] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:37.701287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.701572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.701841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.725869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:37.727104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:37.747345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16c9e-821d-405e-9da5-3fc8d5e6bb8d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.747946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16c9e-821d-405e-9da5-3fc8d5e6bb8d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.748419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f16c9e-821d-405e-9da5-3fc8d5e6bb8d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.749981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 171/340] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:37.754966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:37.755472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:37.756034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:37.790409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:37.791644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:37.843292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 170/341] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:37.898255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:37.908277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 172/342] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:37.921291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.040942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82f0e-4e35-4957-aae0-b8bc3c3530d2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.082886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.083526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.083799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.084069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.095037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.096790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.109772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:38.117147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:38.118144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:38.124213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:38.124213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.124213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:38.124213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 171/343] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:38.125619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.208588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.233828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.265814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01943-4c82-4015-9dd0-ca238a850367 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.276863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301ab2-b24f-4ab8-93f0-8aa69af2c9b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.311431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.311937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.312151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.312480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.312810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.313330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.313946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.314404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.315220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:38.315683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.317275 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.325487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.327550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.330401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 172/344] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:38.331814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:38.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:38.353612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:38.359702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:38.359702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.359702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:38.359702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 173/345] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:38.359702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.457896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6323f-b503-42df-bc8c-1070b624803b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.485251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.486612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a2dac-914c-4282-896a-e583742d47b2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.489973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.499739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.500488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.500783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.501080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.511286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.512730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.523397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.524116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.524393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.524666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.525364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.526786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee4f4-2d59-4c30-8070-308d66613632 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:38.527175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:38.528018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:38.528850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:38.528850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:38.528850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:38.528850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 173/346] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:38.533968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.551717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 174/347] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:38 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:38.553046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc78-e8c7-41a0-8043-511f7257d395 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.553322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc78-e8c7-41a0-8043-511f7257d395 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.553588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc78-e8c7-41a0-8043-511f7257d395 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.557218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 175/348] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:38.557218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdc78-e8c7-41a0-8043-511f7257d395 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.685566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdc78-e8c7-41a0-8043-511f7257d395 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.701197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968ad1e-d6d7-4533-a890-5f3d4c02a975 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.725220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.726237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.726851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.727326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.728193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:38.728595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.730220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20144-9f8f-4748-874a-fb71c00f690f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.741059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.742135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.742663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.743129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.743993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:38.744549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.744957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 176/349] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:38.749557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.749557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.749557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.751275 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.765021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 174/350] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:38.765878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.772678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:38.773986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:38.791360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.807192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:38.865322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 177/351] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:38.866266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:38.888089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955012ba-bce0-4e34-9fed-f0d7c5d510f3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:38.923432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:38.924615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:38.925170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:38.925653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:38.926527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:38.928262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889099f-d3e1-462b-af66-4532c684f090 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:38.952524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 175/352] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:38 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:38.999209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bd1f-8022-44ac-b3b8-2e53a1719434 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:39.043806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:39.044446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.044718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.044984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.045678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:39.047158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f1de0-9cb1-4cf2-8bc4-0c2d63df3faf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:39.070367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 178/353] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:38 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:39.105312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ced6-4b44-4554-b050-1adfd1205003 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.105973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ced6-4b44-4554-b050-1adfd1205003 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.106487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308ced6-4b44-4554-b050-1adfd1205003 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.108597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 176/354] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:39.114419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.114729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.114967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.129406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:39.139559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:39.145871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:39.213323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ced6-4b44-4554-b050-1adfd1205003 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:39.238238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 179/355] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:39.328553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:39.340984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308ced6-4b44-4554-b050-1adfd1205003 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:39.376889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:39.377553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.377826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.378093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.388627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:39.390044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:39.405461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:39.406382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:39.407202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:39.407202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:39.407202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.407202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 177/356] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:39.412611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:39.514280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:39.516248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bff7e-e711-40a4-ae8c-564fe0b02b9b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:39.572329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:39.572961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.573261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.573526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.574182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:39.574480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:39.575854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:39.587475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:39.599726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 180/357] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:39.605330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:39.674517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab8d5d-d2d4-4886-bab7-563f11365354 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:39.727520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:39.728146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.728422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.728688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.729407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:39.730796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:39.743841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 06:29:39.743841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 06:29:39.743841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [parameters: {'id': '1f0b2a5211994122abfcc15a87d28861', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 06:29:39.743841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Oct 11 06:29:39.773439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return ref.to_dict() Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:29:39.774372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 06:29:39.775271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 06:29:39.776108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:29:39.776940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:29:39.777765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'id': '1f0b2a5211994122abfcc15a87d28861', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:39.778532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 06:29:39.779317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:39.780122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 178/358] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 11 06:29:39 2022] POST /identity/v3/roles => generated 144 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:39.781529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:39.790414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca6e5-2234-42c3-aa8c-bb208108ae04 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:39.796546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:39.848880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:39.850153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:39.850427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:39.850700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:39.851357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:39.852832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:39.885650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 181/359] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:39 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:39.969979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832af63-b5af-48fd-a1cd-f5b39584bee4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:40.015767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:40.016687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:40.017153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:40.017586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:40.028865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b4a6c4b8-c8aa-4532-b2da-8f843c34e1c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:40.034485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:40.035611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 06:29:40.036593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:40.039180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 179/360] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:40.045409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:40.115060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:40.173272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23257-acfd-4363-a54a-9da1606fb0fe None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:40.213999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:40.214908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:40.215330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:40.215735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:40.216658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:40.217148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:40.218712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd279c0-ee71-462c-bb11-de6135fbb3cc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:40.229614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 182/361] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:40.992184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd5e-3002-47ad-9e35-7d3f189eaf95 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:40.992741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd5e-3002-47ad-9e35-7d3f189eaf95 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:40.992741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2cd5e-3002-47ad-9e35-7d3f189eaf95 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:40.994351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 180/362] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:40.999773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134792b4-6915-4a58-8d69-deaa54204aeb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.000187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134792b4-6915-4a58-8d69-deaa54204aeb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.000370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134792b4-6915-4a58-8d69-deaa54204aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.019198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-134792b4-6915-4a58-8d69-deaa54204aeb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:41.020388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-134792b4-6915-4a58-8d69-deaa54204aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:41.106014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 183/363] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:41.491050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cd5e-3002-47ad-9e35-7d3f189eaf95 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:41.562880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4079f0-dbdc-4106-925e-dc7399ba135f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.563506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4079f0-dbdc-4106-925e-dc7399ba135f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.563974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4079f0-dbdc-4106-925e-dc7399ba135f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.572552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 184/364] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:41.574168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.574448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.574719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.579317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:41.612462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:41.613692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:41.650417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2cd5e-3002-47ad-9e35-7d3f189eaf95 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:41.690817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:41.718367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:41.719053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.719319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.719578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.738647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:41.744100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:41.744965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:41.746202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:41.747052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 185/365] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:41.747131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 181/366] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:41.753135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:41.891916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eeffdc-3a38-4d84-a1cc-ecaa5c69ccdc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:41.939656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:41.940278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.940549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.940818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.941502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:41.941798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:41.943236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f20210-7497-4ce7-abdf-b5021f36220d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:41.956156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 186/367] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:41.962532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:41.990729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1482-68bc-4c1e-8bad-0b43b5a7b6ad None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.991052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1482-68bc-4c1e-8bad-0b43b5a7b6ad None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.991334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d1482-68bc-4c1e-8bad-0b43b5a7b6ad None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:41.992917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 187/368] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:41.997828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:41.998038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:41.998301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.026900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:42.033478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:42.065405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.092198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c06c-9cdd-4118-a8e8-3fc4aef939ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.101978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 188/369] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:42.109949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.129400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.145812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.146582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.146920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.147248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.169983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.171510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:42.203487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:42.204644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:42.205732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:42.205732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:42.205732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:42.213496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab96269-12b0-4e5e-abfc-9dbc12c41ce1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.214693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 182/370] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:42.220036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.248277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.249014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.249413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.249778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.260070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:42.265145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:42.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:42.267221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:42.268926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 189/371] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:42.274708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.304294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.379490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbb19d-84e7-49f4-8444-2fdfff8d54a9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.418954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.419844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.420214 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.420583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.421371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:42.421765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.423911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.429305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc48d7-da2f-44f2-8e57-3eb705b69e55 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.434442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 190/372] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:42.440377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.468211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.469155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.469594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.470002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.470869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:42.471316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.472959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.485915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 183/373] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:42.487124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.530457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.544704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.558725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f85e9-04c8-4d14-aa72-d7db43b4dff9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.594802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe131a-1bf7-4e7c-8e29-6574370cc3c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.599818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.600517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.600791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.601130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.614480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:42.621368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:42.622198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 191/374] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:42.622857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.635939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.636931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.637493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.637991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.648889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.651803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:42.668722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:42.669735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:42.670558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:42.670558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:42.670558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:42.672672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 184/375] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:42.673668 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.737202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4e143-0c75-4330-8221-3a12289f6e23 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.777685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.779210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.780128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.781352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.781491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.787904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bbeaf-d191-4c0c-b436-e84d99088f3c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.792554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.794202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:42.811810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:42.812776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:42.813743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 192/376] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:42.814312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.829427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:42.832978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.833913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.834407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.834893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.835947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:42.836484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.838120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.847713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 185/377] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:42.848907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:42.937254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64812b7c-491a-4bee-9575-8a2c7c1df109 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.956256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e261f-6788-496a-a101-eef72c05dbc5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:42.972896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.973820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.974145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.974452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.975132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:42.975474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.977449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.990271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:42.990877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:42.991147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:42.991411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:42.992247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:42.992548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:42.993148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 193/378] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:42.994114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362e2c-00ef-40f6-bfc6-2705be010405 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:42.994493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.034933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 186/379] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:43.036421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13b95-4bbb-4ba3-b463-420a2231c991 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.036929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13b95-4bbb-4ba3-b463-420a2231c991 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.036929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a13b95-4bbb-4ba3-b463-420a2231c991 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.038274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 187/380] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:43.038841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13b95-4bbb-4ba3-b463-420a2231c991 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.053469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.062105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.096264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0796c-770e-465b-a91a-10e75003dab0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.131527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.132155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.132427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.132693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.137245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a13b95-4bbb-4ba3-b463-420a2231c991 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.142371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.143818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f1f2b4ee-bce9-44c7-95be-803433be6121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:43.158468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.159369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:43.160190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:43.160190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.160190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:43.160190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 194/381] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.160845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a67b8-b17f-4b9c-bb78-3a8d0839f929 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.160958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a67b8-b17f-4b9c-bb78-3a8d0839f929 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.161252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a67b8-b17f-4b9c-bb78-3a8d0839f929 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.162619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 195/382] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:43.163317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a67b8-b17f-4b9c-bb78-3a8d0839f929 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.176287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.177026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.177302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.177561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.184754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.186262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-981e5af3-f1b4-4261-bfdc-72f1a68acbd3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:43.198762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.199656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:43.200551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 188/383] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.201681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.201681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.201681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.219718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:43.220914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:43.266563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a67b8-b17f-4b9c-bb78-3a8d0839f929 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.284680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 189/384] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:43.285580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.287578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.289904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.304137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.304801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.305153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.305425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.316383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.317964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5dc4d1c8-c0c4-4ca5-86ed-e202aaa51a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:43.333889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.334825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:43.335654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:43.335654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.335654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:43.336358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 196/385] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.337925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.338267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.338601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.357702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:43.358975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:43.401273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50a80c-d3df-4701-b003-0ba22ec37768 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.441021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 197/386] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:43.441021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.447977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.448898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.449222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.449893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.450555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:43.450860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.452264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.467228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 190/387] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:43.468050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.543415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5752-93f4-4ab6-b465-3abca2dc6fc4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.545049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.548897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.581971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.582592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.582856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.583122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.583840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:43.584138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.585599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.599201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7640b2-eb54-4763-b429-91bc8a5f4cd7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.622036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 198/388] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:43.627406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.634099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.634967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.635451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.635865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.636688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:43.637202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.638754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.651677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 191/389] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:43.652610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.740231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbff4e-5481-40bb-ad86-be2ce00cc0f4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.757184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed5b48-1396-410d-bacf-20d5fea40811 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.774863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.775497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.775772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.776045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.779689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.783085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.784543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.791748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.792380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.792653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.792917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:43.796094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.797129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:43.798418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 199/390] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.801891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.803204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:43.808468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.809511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 192/391] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.813948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.826037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:43.902034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca7467-0fa3-4d32-a7db-e7c652900d43 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.910880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0b371-8f12-4cc5-b0cf-287b66929f63 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:43.933922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.934553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.934826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.935090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.942816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:43.943442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:43.943703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:43.943965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:43.945465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.946905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.950508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:43.951936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:43.961788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.962715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:43.963547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:43.963547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:43.963547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:43.963547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 200/392] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.963765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:43.964093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:43.964853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:43.965704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 193/393] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:43.966155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.009149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.033870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.064527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0a605-8b19-45ee-baa5-1e54a1864046 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.065446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba7167-c6a1-4923-a6ce-b3047fe3dea2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.098895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.099512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.099622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.099791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.100057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.100156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.100384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.100652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.101406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.101761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.103466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.110671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.112094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.120360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 194/394] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.120992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:44.126076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:44.126959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:44.127779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:44.127779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.127779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:44.127779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 201/395] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:44.127986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.217047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.221256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36525d1-ad69-4417-ac99-0fd296654cb6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.226078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf74-785b-42de-af80-de0e884f5b60 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.249834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.258059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.258664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.258963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.259184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.259832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.260134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.261134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.261542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.261879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.262213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.262534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.263364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.263853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.265364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.270011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 195/396] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.270787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.282151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 202/397] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.283033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.369487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dcccf-d87c-4826-a47b-45640dc1f735 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.379872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f61337-4b92-4e44-a96a-ca20bd4685f0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.402418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.403011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.403290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.403554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.404242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.404537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.406014 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.414291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.414946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.415213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.415478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.424065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 196/398] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.425065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.425545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.426998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:44.442004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:44.442961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:44.443826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:44.443826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.443826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:44.443826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 203/399] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:44.444051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.456016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.479897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.528970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de3d22-a19f-45af-bc7c-733fe1387850 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.544451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206e552-eec2-47dc-8839-c2ff17121c61 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.561685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.561856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.562076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.562321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.562959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.563251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.564754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.575966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 197/400] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.576717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.581186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.582272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.582621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.582950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.594112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.595553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:44.610170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:44.611177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:44.612012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:44.612012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:44.612012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:44.612012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 204/401] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:44.612012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.659714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.680356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0cca1-5c44-41c1-b9f7-4b497338919f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.702820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.713564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.714189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.714456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.714719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.715923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4327d-0193-437b-b9a1-82263e1fd895 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.721086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.722545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:44.733460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:44.734472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 198/402] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:44.735288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.753031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.753713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.753998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.754256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.768406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=965ff63b01c04728b214e71933f87792, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.769879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.782438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 205/403] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:44 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:44.783198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.856678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960a473-02ff-41bb-99d8-54ed7c41a7fe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.896456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.897132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.897401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.897664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.898377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:44.898656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.900062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.901292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93b2f-66b6-4191-9c4d-0cfdf0562186 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:44.913177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 199/404] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:44.918633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:44.921976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.941169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:44.941797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:44.942063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:44.942324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:44.942974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:44.944452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:44.955471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:44.972943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 206/405] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:44 2022] POST /identity/v3/users => generated 247 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:44.973688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.053280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3410-ad11-4d81-8d8d-ec1db0d7fb86 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.096924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.097956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.098148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b51d0-0509-4abc-b0dd-64be7b6edb65 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.099007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.099474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.100506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:45.101089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.102973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.118828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 200/406] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:45.120076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.137589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.138197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.138469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.138733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.139509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:45.139804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.141370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.162050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 207/407] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:45.162962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.201028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:45.233920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:45.253145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b845833-784b-4cb9-ae44-8a9a7a7d31fc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.289263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264b37c-3e75-4a87-b4b2-62c53b8a7c40 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.300864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.302274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.303169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.303615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.313211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.315911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:45.329903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:45.330798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:45.331985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 201/408] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:45.332433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.338384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.339138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.339414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.339675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.347712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.349323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:45.364072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:45.365042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:45.365916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 208/409] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:45.366955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.441339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bc3-776d-484e-b929-35768c2bb144 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.464935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:45.477506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.478156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.478426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.478691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d21a5a40ab384688bb267a44a749f085/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.489343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cd2d9-6052-4142-b50b-f9cd98d7f943 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.494113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=d21a5a40ab384688bb267a44a749f085, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.495626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.506301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:45.524796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 202/410] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:45 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d21a5a40ab384688bb267a44a749f085/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:45.525770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.528070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.528944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.529484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.529918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.530779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:45.531221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.532831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.552377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 209/411] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:45.554077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.662776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c28b1-8519-4461-8750-e67acc1982e3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.700930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.702047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.702587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.703045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/70f7e360a0824d328c393df1eacbc06e/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.716063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44df9-2d78-4f70-950a-41e7fa583227 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.723136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=70f7e360a0824d328c393df1eacbc06e, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.725132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.757147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 210/412] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:45 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/70f7e360a0824d328c393df1eacbc06e/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:45.801549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.802266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.802547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.802863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:45.803660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:45.803965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:45.805681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:45.831139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 203/413] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Oct 11 06:29:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:45.837573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:45.867874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:45.957252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ed49b-9a62-41bc-9499-144d98f3355a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:45.992153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:45.992741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:45.993030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:45.993321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:46.005701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:46.007187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:46.023673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:46.024642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:46.025515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:46.025515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:46.025515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:46.025515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 211/414] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:46.031698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:46.062870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:46.153064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9424f-596b-4bf9-9d30-23a41a089d9c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:46.202268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:46.202888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:46.203159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:46.203424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:46.204072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:46.204366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:46.205785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:46.218114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 204/415] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:46.224024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:46.319511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:46.342571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9cfb-d82e-4535-b557-a3e737dc8edf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:46.376656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:46.377274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:46.377544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:46.377807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:46.384838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:46.386293 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:46.397878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:46.398780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:46.399603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 212/416] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:46.405499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:46.504947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:46.518942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88127ee-4ba6-4c8a-83f1-79c0e57ab9ff None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:46.561903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:46.562898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:46.563365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:46.563822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:46.564710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:46.565263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:46.566890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeae7d8-3863-46bb-bd69-d2e89abe008e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:46.580096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 205/417] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:46.590074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:46.734941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f51a4-c929-43b8-ac29-42ef96da933b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:46.786549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:46.787221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:46.787492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:46.787758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/f0294ac726964601b44f1d63cb1c2c50/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:46.793994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:46.810828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=f0294ac726964601b44f1d63cb1c2c50, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:46.812328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12ee9-8420-436c-bd78-fb1dfbf8ab04 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:46.837133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 213/418] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:46 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/f0294ac726964601b44f1d63cb1c2c50/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:47.276620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511bf46-fa59-4472-93dc-2657194ba205 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:47.277041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511bf46-fa59-4472-93dc-2657194ba205 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:47.277215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511bf46-fa59-4472-93dc-2657194ba205 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:47.278828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 206/419] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:47.284008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905bbd-1559-49ef-9b42-6f5e3fe129a0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:47.284442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905bbd-1559-49ef-9b42-6f5e3fe129a0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:47.284535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905bbd-1559-49ef-9b42-6f5e3fe129a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:47.310218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-26905bbd-1559-49ef-9b42-6f5e3fe129a0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:47.311448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-26905bbd-1559-49ef-9b42-6f5e3fe129a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:47.400046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 214/420] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:47.582457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2c33-4a9e-46e5-b3a3-3735725c0b43 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:47.583047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2c33-4a9e-46e5-b3a3-3735725c0b43 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:47.583047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa2c33-4a9e-46e5-b3a3-3735725c0b43 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:47.584584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 207/421] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:47.589948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:47.590233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:47.590507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:47.613360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:47.614542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:47.704572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 215/422] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:47.766715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa2c33-4a9e-46e5-b3a3-3735725c0b43 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:47.890660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa2c33-4a9e-46e5-b3a3-3735725c0b43 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:47.940507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:47.941546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:47.942035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:47.942503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:47.958233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:47.963370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:47.964233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:47.965064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:47.967295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 208/423] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:47.974424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.023374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.046230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.069273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.165986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547d04-b7c0-4296-b0ae-43324b9475fb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.203470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780886-4e3c-4015-81ce-d2e794edb768 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.224819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.225497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.225760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.226023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.226759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:48.227056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:48.228465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:48.252576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 216/424] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:48.253601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.276891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.277549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.277825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.278089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.297878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:48.302867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:48.303737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:48.304583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 209/425] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:48.310034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.411525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213579fc-16d7-4d8c-b6d9-e89d7fb05c51 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.425300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.427199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.450772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befb8b9-a066-4d39-8091-184c8276ac23 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.459968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.460931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.461873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.462341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.477298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:48.479851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:48.489414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.490034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.490310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.490579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.491244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:48.491544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:48.492963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f9b7e-9276-4117-8fde-59185063adac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-da887d37-2813-48b0-ab31-9d876e765f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:48.499102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:48.500073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:48.500904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:48.500904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:48.500904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:48.509162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 217/426] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:48.509162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba709-1b72-4dce-aa62-4652c7ec8942 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.509162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba709-1b72-4dce-aa62-4652c7ec8942 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.509162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaba709-1b72-4dce-aa62-4652c7ec8942 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.509162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 218/427] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:48.511673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 210/428] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:48.512492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba709-1b72-4dce-aa62-4652c7ec8942 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.514074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32698-1ae2-4278-bab9-8b8f61b996b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.514359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32698-1ae2-4278-bab9-8b8f61b996b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.514621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32698-1ae2-4278-bab9-8b8f61b996b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.534012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fac32698-1ae2-4278-bab9-8b8f61b996b7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:48.535207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fac32698-1ae2-4278-bab9-8b8f61b996b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:48.610391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 211/429] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:48.612443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11dac-7652-4fab-971b-e9d3f512c691 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.612917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11dac-7652-4fab-971b-e9d3f512c691 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.613419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11dac-7652-4fab-971b-e9d3f512c691 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.614842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 212/430] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:48.615697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11dac-7652-4fab-971b-e9d3f512c691 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.632658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaba709-1b72-4dce-aa62-4652c7ec8942 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.668882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.669559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.669877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.670183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.670937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:48.671284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:48.672809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b2fff-c005-4101-b4fd-1bb77d019bf2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:48.690265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 219/431] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:48.690265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.690265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.690265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.698490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.713450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:48.714645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:48.730952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:48.756241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11dac-7652-4fab-971b-e9d3f512c691 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.793337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 220/432] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:48.794365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.803458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:48.804392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:48.804950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:48.805463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:48.817471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:48.819195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:48.837258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:48.838193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:48.839036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:48.839036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:48.839036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:48.845467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 213/433] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:48.847158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:48.955294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bedbf9-1bf7-48c8-a776-3e36c4b0d160 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.968074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea973c8-45b0-43d9-9768-e2fc9ab9dc82 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:48.971382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.002434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.003398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.003852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.004205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.005169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:49.005536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.006476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.007164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.007499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.007977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.008404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.016156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.017901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.025102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 214/434] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:49.026210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:49.032810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.033692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:49.034550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:49.036915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 221/435] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:29:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:49.037903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.061255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.137497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beba7f-95ed-4cc4-b72b-8773d3ad36a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.167845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834134-6648-40e7-9d42-42d6456f4c15 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.172242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.172893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.173174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.173441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.183599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:49.188400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.189312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:49.190099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 215/436] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:49.190746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.209088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.209628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.209912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.210181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.217872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.219312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.226685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:49.230275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.231613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 222/437] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:49.238295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.303472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ee9de-72d4-453a-a282-cf6a57ece6d0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.308820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.341793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.342430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.342717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.342969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.343711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:49.344009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.345541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.346391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c796-61fb-4b2c-b9d9-5a92f0b49d93 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.369403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 216/438] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:49.369403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.389440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.390145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.390422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.391121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.401817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:49.407143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.408008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:49.408789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 223/439] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:49.410099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.472469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.481745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3be8-d11c-4157-a729-dcb0a97e5b64 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.514202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.514906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.515203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.515466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.516127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:49.516400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.517806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.519981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f0a6-9be1-45e6-8794-8c072ce49646 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.525620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 217/440] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:49.526323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.551639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.560960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.561603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.561875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.562141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.562859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:49.563158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.564577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.581859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 224/441] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:49.582640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.631293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222bfa-0e15-4eca-93c3-11a14b28e325 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.664057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.664666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.664939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.665234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.677174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7990e-3eda-4fc8-a1ac-34f18f92830c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.687695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.711923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.712521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.712796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.713092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.713747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:49.714068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.715453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ed89-90ac-47f4-a7c6-911f1b0a1f25 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.723290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 225/442] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:49.724354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56a3e-7ef9-45ef-bcb5-75493eae9a6b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.724631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56a3e-7ef9-45ef-bcb5-75493eae9a6b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.724904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56a3e-7ef9-45ef-bcb5-75493eae9a6b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.726258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 226/443] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:49.726823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56a3e-7ef9-45ef-bcb5-75493eae9a6b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.736523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.738016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.778312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.829466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56a3e-7ef9-45ef-bcb5-75493eae9a6b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.835174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 218/444] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:49.836035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.862710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.863344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.863613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.863885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.874271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.875728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.889305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:49.889755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.890744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:49.891723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:49.891723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:49.891723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:49.893143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 227/445] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:49.894419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:49.936583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bf5f-015c-4f93-b408-d0512e173fb4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.970808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:49.971434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:49.971707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:49.971969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:49.981790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:49.983162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:49.992694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e7fda-4ce8-4950-9390-64f1ac6da438 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:49.994212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-28e14da4-49b1-43e6-93cc-8becedaff098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:49.997599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:49.998637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:49.999755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:49.999755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:49.999755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:49.999755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 219/446] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.004377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.004645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.004913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.022161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:50.023382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:50.028725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.029394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.029670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.029939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.041251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.042711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:50.057064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.058127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:50.064017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:50.064017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:50.064017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:50.064017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 228/447] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.064017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.089974 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 220/448] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:50.090856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.125117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.169010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5629d4-65fb-4d85-bfa9-09606eb8acfc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.195201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b70d0-3566-44e0-8133-6662914e87fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.203511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.204153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.204430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.204697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.215896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.217362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.229379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.230052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.230386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.230713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.231415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:50.231775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:50.231920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.237559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:50.238707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:50.238707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:50.238707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:50.238707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 229/449] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.238993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.239077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.246832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.254667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 221/450] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:50.254667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.349748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700ddd-fa9b-4a89-8581-55097a3eb4e6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.353190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.361131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3092a-2b27-4132-a92c-446396a1cee6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.382590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.383200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.383469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.383733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.384363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:50.384655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.386040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.394060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.395111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.395393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.395656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.396296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:50.396596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.397417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 230/451] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:50.398000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.398244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.414112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 222/452] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:50.414914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.464619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.498407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d10e-68f0-4f6c-aad4-0d792db31448 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.512797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14599c00-4862-4620-a2f6-2d16818299c5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.532465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.533103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.533378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.533642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.534339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:50.534638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.536059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.545173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.545796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.546069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.546335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.546944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 231/453] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:50.547733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.557213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.559035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:50.573641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.574518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:50.575392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 223/454] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.575933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.594409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.654326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05a7e-df8a-4aac-968a-e7faf4c0ca76 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.674580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ea38b-aeb3-4ade-846b-0b9a728fcb8d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.679057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.688911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.689573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.689851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.690117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.699966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:50.705185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.706044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:50.707240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 232/455] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.707899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.707980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.708045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.708045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.708710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.716593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.718115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:50.731078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.731958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 224/456] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.732972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.808104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.816687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb34975-eb9f-449b-a4ee-1544c8ba45ef None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.830016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1721a-e1bb-4a84-9fab-975701ab9f91 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.849083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.849703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.849976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.850240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.857610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.859052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.863024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:50.863649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:50.863917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:50.864179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:50.870001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.871080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 06:29:50.871964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:50.872456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:50.872525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 233/457] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.872525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.872646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:50.886547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:50.887394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 225/458] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:50.888967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:50.923760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:50.980316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3719c-0f59-4eea-abd5-b160b9efa179 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:50.990030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea6c8-a5a1-4f63-82dc-6e8c849b7e01 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.013093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.013693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.013966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.014231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.014949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.015244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.016708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.022758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.023406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.023681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.023951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.024611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.024914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.026309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.028429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.033949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 234/459] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.034748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.035157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 226/460] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.035962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.134574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedf95f-aef8-4308-96d8-cf3287c92391 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.135937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918485e-a9d5-4037-90bc-77fac7213907 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.136826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.168499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.168989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.169137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.169388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.169625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.169726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.169888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.170151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.170304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.170598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.170872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.171171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.172030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.172582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.184435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 235/461] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.185066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.189755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 227/462] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.190565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.244776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.285500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c3ba-2196-44ae-b3ee-626384c63280 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.286565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c4e91-4495-4988-a441-4f466f4a9104 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.318967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.319549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.319691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.319799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.320126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.320253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.320454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.320722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.320849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.321150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.322570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.335952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 236/463] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.336888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.362043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.388515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.389953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.435877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7a597-8021-4ca3-a456-4d2272476474 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.442722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.470515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.471132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.471403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.471662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.481630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.483050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.488547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 228/464] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:51.489370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:51.497671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:51.498558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:51.499385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:51.499385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:51.499385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:51.499385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 237/465] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:51.499602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.577588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.593046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c179-4181-486f-a2d7-cf2d4705a3b9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.602651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8e04-b6f0-4efd-a942-92bf9c079089 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.626379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.627036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.627287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.627552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/7f4ea301b8f046c3b9a7e4737775c5f3/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.635376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.635993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.636262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.636522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.641662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=7f4ea301b8f046c3b9a7e4737775c5f3, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.643119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.655630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 229/466] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:51 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/7f4ea301b8f046c3b9a7e4737775c5f3/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:51.656415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.666046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.712821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.714498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.766804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce52c13-ff1f-45b3-9dae-cbbe14438b42 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.802515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.803549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:51.805433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:51.805847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:51.806139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:51.806930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=965ff63b01c04728b214e71933f87792) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:51.807302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:51.808796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:51.815201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 230/467] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/role_assignments?user.id=965ff63b01c04728b214e71933f87792&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:51.816056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.849748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 238/468] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:51.851499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:51.940892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:51.983468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135d40e-34da-4a4f-ba58-56331f3c4003 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:51.995916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9daca9-c12b-463b-be43-c4f24358a42a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.020159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.020904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.021276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.021609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.032628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.034181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.038803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.039423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.039691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.039952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.040585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:52.040883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.042296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:52.050377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:52.051286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:52.052120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:52.052120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:52.052120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:52.053861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 231/469] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:52.053964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 239/470] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:52.058519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.059887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.096239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.167206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24209812-98fc-4f88-92b5-62dfc61dc7f8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.180193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88d3d0-6042-43ad-acc3-7458885c28a9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.202225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.202786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.203059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.203324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.210302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.215596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.217077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.227222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.228080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.228498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.228910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.229739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:52.230195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.231722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:52.231934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:52.232985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:52.234095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:52.234095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:52.234095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:52.237652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 240/471] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:52.238522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.249748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 232/472] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:52.251291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.328911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.342836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9757e-66f0-409b-98cd-5a8a4293b092 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.391124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.391773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.392040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.392307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.397899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819f1e8-dbb9-4042-89ba-3d02e8bcd350 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.403848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.405578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:52.418256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:52.419227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 06:29:52.420079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:52.422427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 241/473] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:52.423422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.438108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.438740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.439015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.439283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.440209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:52.440511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.442088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.457371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 233/474] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:52.461982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.519126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.545108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5091db-52a0-470e-a109-65664234df28 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.592233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.593040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.593297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.593570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.598908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85985d09-44f7-4ea1-9201-3add000a3724 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.604268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.605855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:52.621993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:52.622891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:52.623718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 242/475] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:52.624640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.638233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.639161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.639624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.639740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.640204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.641192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:52.641769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.643390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.663132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 234/476] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:52.664424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.751668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57a77f-5e34-4017-ad56-e7062362621b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.786370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.790869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80405593-2af9-46ef-b6ef-96b5c6703d20 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.793013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.793912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.794384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.794835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.802606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.804510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:52.818487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:52.819375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:52.820349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:52.822814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 243/477] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:52.823973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.839727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:52.840354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:52.840627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:52.840898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:52.841701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:52.842474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:52.844334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:52.861153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 235/478] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:52.862332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:52.918383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:52.968487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e3f89-572b-44f8-9b7c-f1d23e0e2fbf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:52.972488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce0bda-4dc7-402f-9eb0-e4cc66dffe7c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.006175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.006709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.006969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.007294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.008017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:53.008328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.009775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.012149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.013356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.013880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.014364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.023219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 236/479] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:53.024321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.052507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:53.088557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.090110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.155318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cab97d-29ca-4013-baf4-038e58e77abd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.160133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:53.195309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.195920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.196194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.196462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.197333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=d21a5a40ab384688bb267a44a749f085) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:53.197644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.199208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.202906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 244/480] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:53.204234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.213107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 237/481] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/role_assignments?user.id=d21a5a40ab384688bb267a44a749f085&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:53.214498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.371541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d03df-b335-477a-9129-9f7fa07c31c7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.387194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:53.408971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b66544-42c1-4df3-a385-0697d4919de3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.447411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.448460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.449020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.449408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.449719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.450051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.450358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.450662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.451837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=70f7e360a0824d328c393df1eacbc06e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:53.451837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.453321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.460347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 245/482] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/role_assignments?user.id=70f7e360a0824d328c393df1eacbc06e&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:53.464946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.466659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:53.487082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:53.488122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:53.488933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:53.488933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:53.488933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:53.491323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 238/483] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:53.496991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.566944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:53.659636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669f8a6-ab83-4e92-82ed-1d6a062f55c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.703234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.703870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.704175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.704471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.705191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:53.705522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.707284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.720940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 246/484] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:53.726261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.836371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29dcdd-0fbb-418b-b5d9-1f5081059ece None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:53.875573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:53.876603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.877103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.877560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.881050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:53.886948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:53.888443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5e651b03-0116-4be2-8631-ba9bb3e087fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:53.900395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:53.901380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:53.902198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 239/485] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:53.907461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:53.977661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2dce-bc89-498a-b26b-4ba19d44ad52 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.978227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2dce-bc89-498a-b26b-4ba19d44ad52 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.978665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc2dce-bc89-498a-b26b-4ba19d44ad52 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:53.984284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 240/486] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:53.986212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:53.986667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:53.987139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.006133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:54.007654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:54.034501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:54.048652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab3b8d-eaee-41f0-8169-bb29f62de536 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:54.113482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:54.114442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.115211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.116216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.118521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:54.119036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:54.121631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ce93e-4421-43e7-a254-c53631c14e05 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:54.129157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 241/487] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:54.142694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 247/488] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:54.148403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:54.281746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1565ba-98af-41a8-b2ef-635655a5af10 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.282306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1565ba-98af-41a8-b2ef-635655a5af10 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.282739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1565ba-98af-41a8-b2ef-635655a5af10 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.284358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 248/489] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:29:54.284723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547329bf-02c3-4f50-b143-50cff75ebad9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:54.289594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.289878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.290153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.322632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:54.335315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:54.337376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:54.338204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.338644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.339091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.340233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:54.341174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=f0294ac726964601b44f1d63cb1c2c50) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:54.341666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:54.345378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:54.359396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 242/490] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:54 2022] GET /identity/v3/role_assignments?user.id=f0294ac726964601b44f1d63cb1c2c50&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:54.487603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 249/491] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 06:29:54.577682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:54.680225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae34d6-c75c-497b-adbd-a83593ce1a2f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:54.714116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:54.715174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.715650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.716132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.728529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:54.734837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:54.735700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:29:54.736472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:54.739591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 243/492] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:29:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:54.744936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:54.784497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:54.857503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:54.874397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfab7bb-d7b5-4a02-8d44-35c1d7740355 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:54.882048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:54.912661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:54.913804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:54.914280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:54.914755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:54.915605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:54.916121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:54.917899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:54.927546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 250/493] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:29:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:54.938152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:54.970235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b5e0c-b4a9-4413-a5c8-00798d27c303 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.032638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.033298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.033568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.033831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.055509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:29:55.060852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:55.062209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:55.063273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 244/494] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:55.067917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.090407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a8348-bc42-40f0-9513-766b2175dfa5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.149460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.150098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.150366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.150629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.172354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.173841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.178633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:55.197329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:55.198321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:55.199172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:55.199172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:55.199172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:55.199172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 251/495] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:55.209063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.254659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4ac3-a293-4e51-9408-0ba4aff8f48e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.270855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:55.313647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.314311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.314587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.314854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.315763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:55.316068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.317876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.332975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 245/496] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:55.338764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.394052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fbd4b-8529-4158-96f0-5cda721bfa98 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.444732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.445540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.445813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.446345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.447107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:55.447405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.448877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.466307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 252/497] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:55.471888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.537477 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17fcfb-08a6-443a-8271-862dec051480 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.575689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:55.620806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d06ed8-49b5-40cf-a611-d4fbd4f25976 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.630265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.630925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.631203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.631483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.652814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.655739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:55.685176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:55.686252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:55.687123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:55.687123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:55.687123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:55.693090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 246/498] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:55.693795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.694487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.694863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.695089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.695334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.711944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.713678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:55.734323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:55.735491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:29:55.736598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:55.747038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 253/499] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:55.749672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:55.751872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.906065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2f837-0fbf-411b-85b9-36c4b749cc30 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.926784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fa1cf-1e06-4bfc-83a8-5083b3c0dcd7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:55.943975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.944748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:55.946462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.947026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.947442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.948447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:55.948915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.950653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4868-1c34-452a-ae0f-f8986ddf0558 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.966836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:55.969182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.969182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.969182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.969182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:55.969864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:55.971571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613bdad-231e-46a2-b110-a4436e462999 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:55.971809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 247/500] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:29:55.973363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a112d-e433-4dc6-90d3-cf748d85dfd5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.973642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a112d-e433-4dc6-90d3-cf748d85dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.973911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a112d-e433-4dc6-90d3-cf748d85dfd5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:55.980571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 248/501] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:55.980571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a112d-e433-4dc6-90d3-cf748d85dfd5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:55.996295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 254/502] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:55.998049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:55.998333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:55.998602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.017179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:56.018487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:56.079132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.095953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 255/503] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:56.097191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.109163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a112d-e433-4dc6-90d3-cf748d85dfd5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.152797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.153776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.154455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.154874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.164841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.167468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b4592d2b-df85-456a-9918-3323d4ce9d9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:29:56.183365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:56.184541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:29:56.185882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:56.188280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 249/504] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:29:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:29:56.189964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75813-de19-46f0-9979-8999740341cd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.190388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75813-de19-46f0-9979-8999740341cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.190797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f75813-de19-46f0-9979-8999740341cd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.197307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 250/505] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:56.198213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75813-de19-46f0-9979-8999740341cd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.208915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9046d-bdc2-4edb-b2f4-046b863d632b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.212570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.247243 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.248657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.248657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.248657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.324414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.326097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.340080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f75813-de19-46f0-9979-8999740341cd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.383573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.384226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.384490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.384755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.385520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:56.385820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.387271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e19467-1c9f-4f56-a58e-521552ae20f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.405734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 251/506] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:56.406948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.407229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.407557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.413779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.426423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:56.427604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:56.440276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 256/507] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 06:29:56.440276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.442893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.506445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 252/508] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:56.507571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.561027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecea9f4-b34f-4f19-b113-7f4f3b325dc2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.605736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.606671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.607106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.607750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.609213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.611033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:56.626032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:56.627273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:29:56.628317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:56.630424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 257/509] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:56.631044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.647676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a8f44-111d-420e-925a-8b533ea07fa4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.678130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.683676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.684688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.685365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.685831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.696824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.698448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:56.716302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:56.717496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:56.718584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:56.718584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:56.718584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:56.719732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 253/510] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:56.720585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.724911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.772806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9c804-e83a-4012-992d-8cf00a0c6e63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.819381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.820760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.821523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.822422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.827858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcf627-d339-4d07-bfba-418e1fd56279 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.838107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.840459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:56.856352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:56.857482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:56.858366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:56.858366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:56.858366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:56.858366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 258/511] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:56.858366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.871590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:56.872212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:56.872483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:56.872939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:56.873402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:56.873699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:56.875071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:56.879679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 254/512] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:56.880456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:56.928853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:56.973524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba69ce4-284a-453b-aa02-db5ef19b95c4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.980764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f272-3ff2-4ce2-94a4-e73ad162bbec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:56.992716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.006587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.007203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.007516 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.007776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.008425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.008820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.010222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.012899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.013568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.013840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.014104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.021592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 259/513] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.022371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.024539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.026182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:29:57.040378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:57.041537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:29:57.042606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:29:57.042606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:29:57.042606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:57.042606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 255/514] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:57.042606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.123988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aaebf-60a5-4ca6-8e61-235d2b03ccbb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.133852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.137071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7526-e5db-4df7-ba61-df2114c9146a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.158808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.159425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.159700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.159971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.160609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.160919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.162350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89653b5d-6721-43a9-8cb3-37d388f2e628 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.170601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.171202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.171472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.171734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.172350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.172641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.173754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 260/515] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.174015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.174950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab863b-de98-4f11-9f4a-7627abc8eef6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.175232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab863b-de98-4f11-9f4a-7627abc8eef6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.175497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab863b-de98-4f11-9f4a-7627abc8eef6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.176670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 261/516] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:57.177382 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab863b-de98-4f11-9f4a-7627abc8eef6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.183294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 256/517] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.184292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.233386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.297686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8910a-577d-4db6-bae2-684c1dd7fe16 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.306841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab863b-de98-4f11-9f4a-7627abc8eef6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.334420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.335053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.335330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.335648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.336306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.336604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.338065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.345879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.346185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.346424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.346686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.356315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 257/518] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.356315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.357822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.359549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b1b35477-45d7-4387-8275-41c395b48b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:57.374145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:57.375066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:57.375950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 262/519] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:57.376894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.377017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.377634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.384601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.396718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:57.397996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:57.469780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcfe1-8e66-4db3-8ce4-ae377782ff01 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.477367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 263/520] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:29:57.478786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.506820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.507905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.508377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.508834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.516538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.517199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.519290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:29:57.533543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:57.534495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:29:57.535387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:29:57.537606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 258/521] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:57.538765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.606478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6d1fa-1b77-4c7e-bd96-315950866fe9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.636040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.652339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.652960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.653270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.653535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.654185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.655001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f198a2d-7fd7-4127-8407-e563d0ddbcce None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.655618 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.681473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 264/522] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:29:57 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:29:57.682636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.707030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.707030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.707030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.707030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.707487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.707487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.707487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.721274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 259/523] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.727040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.817064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:57.847256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661ef7b-d1bb-4b9f-b1c2-7390892051e9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.865962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c72c62-0e0f-478c-9f49-f355847b8523 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:57.902969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.903598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.903875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.904142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.906760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:57.907141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.908751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.914107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:57.914497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:57.914772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:57.915041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:57.916987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=965ff63b01c04728b214e71933f87792, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:57.919306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:57.925928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 265/524] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:57.926854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.939030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 260/525] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:29:57 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:29:57.939780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:57.944593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:58.071773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372696e-34e7-4bee-8e74-490470eb7189 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:58.089585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb284af-7930-4a1d-9438-f2adf9428269 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:58.151573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:58.152585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:58.152856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:58.153156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:58.153754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:58.155114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:58.161528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:58.162473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:58.162953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:58.163385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:58.164478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=7f4ea301b8f046c3b9a7e4737775c5f3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:58.165054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:58.166713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:29:58.167719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:29:58.168739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:29:58.170933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:29:58.174206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 266/526] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:29:58.175531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:58.177825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 261/527] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:29:57 2022] GET /identity/v3/role_assignments?user.id=7f4ea301b8f046c3b9a7e4737775c5f3&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:58.195805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:58.297754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5510f-0c35-4b7d-84c1-b755a4e937c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:58.338574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:58.339130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:58.339403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:58.339669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:58.340309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] RBAC: Adding query filter params (name=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:58.340606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:58.342114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a900-c7bf-43e6-ad56-30052061ac4b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:58.347691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 267/528] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:29:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:58.354133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:29:58.469054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:29:58.506436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27259fc-dd7c-4fc1-a661-275c6d5f3ca8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:29:58.541999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:29:58.542875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:58.543295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:58.543709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:58.544508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] RBAC: Adding query filter params (type=network) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:29:58.544949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:29:58.546506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6952b2-6c96-4ea8-a7d7-168b782c4b87 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:29:58.551594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 262/529] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:29:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:29:59.554399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cb7b-5d0e-4e97-9af3-e623a0a665e5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:59.555014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cb7b-5d0e-4e97-9af3-e623a0a665e5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:59.555014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1cb7b-5d0e-4e97-9af3-e623a0a665e5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:59.556540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 268/530] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:29:59.570701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1544f-9b4f-48a6-be80-4e9ea5fc3e64 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:29:59.571616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1544f-9b4f-48a6-be80-4e9ea5fc3e64 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:29:59.572104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1544f-9b4f-48a6-be80-4e9ea5fc3e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:29:59.602143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-84f1544f-9b4f-48a6-be80-4e9ea5fc3e64 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:29:59.603618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-84f1544f-9b4f-48a6-be80-4e9ea5fc3e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:29:59.702632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 263/531] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:30:00.070119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1cb7b-5d0e-4e97-9af3-e623a0a665e5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:00.152239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:00.182371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1cb7b-5d0e-4e97-9af3-e623a0a665e5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:00.219842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:00.220591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.220864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.221168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.221837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:00.223238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f02764-f6da-4777-a6aa-a0dfee1df962 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:00.250777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 269/532] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:00 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:00.334202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243d05-26d1-49e2-b73e-de9dfe2dfeaf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.334400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243d05-26d1-49e2-b73e-de9dfe2dfeaf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.334645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243d05-26d1-49e2-b73e-de9dfe2dfeaf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.336210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 264/533] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:00.342116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9cde8-3cef-4dd2-ac37-779282924601 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.342440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9cde8-3cef-4dd2-ac37-779282924601 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.342703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9cde8-3cef-4dd2-ac37-779282924601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.366106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-45d9cde8-3cef-4dd2-ac37-779282924601 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:00.367361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45d9cde8-3cef-4dd2-ac37-779282924601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:00.458117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 270/534] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:30:00.573610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a7bc-dd5d-43a3-8bec-eb4d93161389 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.574149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a7bc-dd5d-43a3-8bec-eb4d93161389 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.574149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075a7bc-dd5d-43a3-8bec-eb4d93161389 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.575622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 265/535] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:00.580787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.581669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.581841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.604907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:00.606102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:00.676146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:00.691915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 271/536] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:30:00.740756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075a7bc-dd5d-43a3-8bec-eb4d93161389 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:00.819195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:00.870726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075a7bc-dd5d-43a3-8bec-eb4d93161389 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:00.912703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:00.913454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:00.913846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:00.914111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:00.924644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:00.929665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:00.930569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:00.931392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 266/537] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:00.938401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.041826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.078605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0df8d-0e69-4ab8-be97-a1922d0d977c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.114875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.115882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.116374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.116878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.117767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:01.118279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.119867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.133022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 272/538] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:01.134920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.190027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.200288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd368-394b-49dc-beb5-49f179bc10c9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.233376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.240498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f133e75-a9a6-4396-92d5-c635c29dc1f3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.241709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.243659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.244161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.244641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.258815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-acac43c8-4555-41f3-a674-d96d6e0d1db7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:01.265534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:01.266563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:01.267403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:01.275481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 267/539] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:01.275481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf308d-de4b-4ba8-a3b8-e5db6f8dc56d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.275481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf308d-de4b-4ba8-a3b8-e5db6f8dc56d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.275481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf308d-de4b-4ba8-a3b8-e5db6f8dc56d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.276956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 268/540] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:01.278661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf308d-de4b-4ba8-a3b8-e5db6f8dc56d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.292260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.293499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.294131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.294654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.307280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.309406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-24ef6f7c-2d50-4efd-af38-7bfb754decad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:01.327696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:01.328747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:01.330075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:01.330075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:01.330075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:01.337260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 273/541] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:01.339182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.339737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.340320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.361166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:01.362717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:01.392510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf308d-de4b-4ba8-a3b8-e5db6f8dc56d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.428265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.428878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.429282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.429548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.430303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:01.430601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.432099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34c9e-d7b1-43ed-88fc-152fd0841ae0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.439400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 274/542] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:30:01.440578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.445447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 269/543] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:01.445447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca41a1-105e-4b9b-a0bd-95e4527eab3b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.445447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca41a1-105e-4b9b-a0bd-95e4527eab3b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.445447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca41a1-105e-4b9b-a0bd-95e4527eab3b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.445447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 270/544] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:01.446782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca41a1-105e-4b9b-a0bd-95e4527eab3b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.486522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.501153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.558023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca41a1-105e-4b9b-a0bd-95e4527eab3b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.575132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022057f-4e9c-470b-8874-888bd177ccff None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.594278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.594899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.595169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.595432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.605426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.606896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.619100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.620358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.620877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.621366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-16d4a531-f33a-42e2-a301-2e93baa36777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:01.622123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:01.623035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:01.623905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:01.623905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:01.623905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:01.624665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:01.625212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.626900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.627817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 271/545] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:01.629026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.629306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.629583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.640902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 275/546] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:01.642046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.657661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:01.659427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:01.741907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 272/547] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 06:30:01.742750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.753890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.763407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e0045-c73d-480d-bb68-421b4621e4dc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.783629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:01.802957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.803921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.804459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.805089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.806285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:01.806790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.808835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.823398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 276/548] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:01.824559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.869977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af552b-63c9-44b4-9006-9cd2a6b9d749 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.912357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.912919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.913214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.913549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.924490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.926256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:01.942278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:01.943226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 273/549] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:01.944206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:01.948005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afdd8-1d77-42c7-b11f-62742e0928ea None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:01.987677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:01.988777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:01.989279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:01.989765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:01.990607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:01.992335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.012486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 277/550] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:01 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:02.013661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.045455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.046773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.064462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf5fb-dac3-4f2f-857e-164a5eded858 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.110694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.111346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.111608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.111871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.120948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.122465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:02.135713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:02.136706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:02.137909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 274/551] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:30:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:02.138475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.145706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcce1e-433d-4ad4-be58-7d92c9043752 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.188192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.188748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.189029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.189402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.190177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:02.190481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.192231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.214833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 278/552] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:02.215688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.265635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a1a6-d182-4f2f-9f0b-1a16ced5771b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.303016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.304176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.304684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.305200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.310587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.318163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:02.324493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:02.325657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:02.326505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:02.329198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 275/553] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:02.330276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.333896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.349047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb21b30-c667-47d4-90bd-b7a7982f218a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.396288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.397631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.398405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.398843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.399983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:02.400855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.402836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.426881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 279/554] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:02.428852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.447672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c135e9b-72b9-4f95-8bc8-19cf52d40689 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.484486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.485179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.485457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.485726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.498018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.499619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:02.514533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:02.515518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:02.516411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:02.516411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:02.516411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:02.516411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 276/555] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:02.517080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.563459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63a9-9e61-4c12-9255-fdf6afb7a79f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.593686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.599164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.608005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.609530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.610311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.610781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.611897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:02.617367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.619544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.632985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 280/556] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:02.634152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.644572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e79d-d37f-4708-bd4b-503b86a93e3f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.682279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.683163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.683536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.683902 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.763939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6f633-d3b1-491b-8c86-e8b8a9c2fd5a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.765919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.768448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05a5d6-1a9d-4d3f-9344-337bda8bb221 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.805984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.806599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.806875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.807151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.807786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:02.808085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.809486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.821935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 281/557] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:02.823620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.831796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 277/558] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b413-79f5-4f28-b71e-1ae40527dac9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b413-79f5-4f28-b71e-1ae40527dac9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b413-79f5-4f28-b71e-1ae40527dac9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 278/559] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:02.882272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72b413-79f5-4f28-b71e-1ae40527dac9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:02.884199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:02.932369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7b13a-ff7a-4694-8512-12ae4bd925ff None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:02.970318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:02.971094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:02.971371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:02.972065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:02.988125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:02.989783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:02.991297 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72b413-79f5-4f28-b71e-1ae40527dac9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:03.008886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.009897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:03.010764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:03.010764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:03.010764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.010764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 282/560] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.010981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.032046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.032758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.032870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.033145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.040201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.041723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5494145a-ec76-481f-b882-7bb6b1c2e48f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:03.053342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.054269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:03.055176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 279/561] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.056454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.056454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.056454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.074258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:03.075451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:03.086081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.121830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd5c58-0d8b-439e-9037-45da703a4b78 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.124111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.148622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 280/562] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:03.149608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.168141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.169397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.169851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.170320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.184112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.186485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:03.203666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.204639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:03.205549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:03.205549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:03.205549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.208139 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 283/563] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.209153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.261043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc578-30c5-47cf-be5d-0c60b5bf9da7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.301260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.302101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.302586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.303017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.303795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:03.304288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.305862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.324742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 281/564] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:03.324742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.330384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.335418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292894-e924-4e9f-8a98-0ae0f275ae64 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.372128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.372790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.373104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.373373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.374502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:03.374502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.375835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.393120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 284/565] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:03.393120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.410531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.468935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73307fea-b169-4131-82b1-bee6441b1408 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.495939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f156-8d8c-4751-9a9d-d38fff766d4d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.506505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.507146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.507487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.507766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.508406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:03.508705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.510108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.522063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 282/566] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:03.527470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.531355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.531688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.531962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.532248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.539473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.540901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:03.552967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.553920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 285/567] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.554889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.597754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.638885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef996e93-0226-42c0-b8dd-8f57315dc15d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.641682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.666827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27689415-5bd1-4262-b1a7-1f921c89954e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.675678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.676747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.677057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.677332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/026603d0fbbd4770b3cc8564c35ca2dd/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.694174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=026603d0fbbd4770b3cc8564c35ca2dd, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.695676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.705233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.706871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.707329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.707803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.708596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.709336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 283/568] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:03 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/026603d0fbbd4770b3cc8564c35ca2dd/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:30:03.710142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.710674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.731244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.732341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:03.733268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 286/569] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.734074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.851911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd31223-5d81-4294-8e71-95bd4c3498f4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.867126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536e69-50af-4f22-bb1f-61c5fadfc154 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:03.883220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.893457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.894100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.894376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.894729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.895555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:03.895921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.897489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.912717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:03.915134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:03.915909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:03.916280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:03.916645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:03.925120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 287/570] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:03.926112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:03.926937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:03.928687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:03.941478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:03.942698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:03.943601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 284/571] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:03.944087 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.052014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11248015-8181-430e-ac4e-8fedfc9ab27f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.071872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5665fc-76d8-44bd-abc3-dbfea607ee32 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.091803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.092805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.093281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.093740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.094554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.095008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.096547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.102940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 288/572] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.103906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.124837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.125742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.126746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.127148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.143697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.145671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:04.167963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:04.169332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:04.170481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:04.170481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:04.170481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:04.173070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 285/573] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:04.174041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.191431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.216286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.240745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73371087-3e17-4983-9b7e-894320faec17 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.277143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.277987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.278408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.278812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.279645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.280117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.281748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.294271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 289/574] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.295184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.302209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94364-6d43-432c-9dd2-b6c428e0036a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.335035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.335678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.335949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.336214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.336839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.337212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.338578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea39625-816e-4eb1-a91c-071dd1f92beb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.348600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 286/575] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.348600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150d7a-a466-4b9b-9ff1-a60a0c47e4fe None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.348600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150d7a-a466-4b9b-9ff1-a60a0c47e4fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.348600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72150d7a-a466-4b9b-9ff1-a60a0c47e4fe None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.351353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 287/576] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:04.352093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150d7a-a466-4b9b-9ff1-a60a0c47e4fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.409068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998454c-bdb3-479d-8dfd-2a1c6e9b04da None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.431827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.444126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.444704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.445474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.445784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.446297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.447061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.447441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.448935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.457386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72150d7a-a466-4b9b-9ff1-a60a0c47e4fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.462896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 290/577] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.464023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.495496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.496242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.496521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.496787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.497548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=965ff63b01c04728b214e71933f87792) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.498088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.499307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983f4ac-fdb5-40db-9420-d8bf2e759eb7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.513052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 288/578] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/role_assignments?user.id=965ff63b01c04728b214e71933f87792&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.513052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.513052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.513052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.529144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:04.530548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:04.591255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612dec-9563-4f50-8cf6-e4c33d35e93e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.612623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 289/579] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:04.613535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.645795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.649457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.649457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.649457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.649963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] RBAC: Adding query filter params (interface=public, service_id=d94f6e866bd4455bb6f14645fdafd265, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:04.650226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.652875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.670728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 291/580] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/endpoints?service_id=d94f6e866bd4455bb6f14645fdafd265&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:04.677736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.759585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.768077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:04.792918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ebfd6-6443-41f6-96dd-aba9405da9f2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.828173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50918fa7-e59a-4822-92d2-e11c2c181888 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:04.828787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.829462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.829739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.830008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.837302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.838769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:04.851456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:04.852358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:04.853520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 290/581] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:04.858815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.864430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:04.865080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:04.865362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:04.865632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:04.866250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:04.867683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:04.873575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 292/582] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:04.935958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:04.974041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8797-a777-4b3f-84aa-4aa12a50bf9e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.011358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.011989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.012266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.012536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.013269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:05.013577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.015038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.032926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 291/583] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:05.034299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:05.039092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:05.067272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8e9a-0992-4845-bee7-07fbc61df639 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.080207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:05.138409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.139429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.139937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.140397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] PATH_INFO: `/v3/services/network` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.141208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.142784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:05.154694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:05.155786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:05.156680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:05.160639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 293/584] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:04 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:05.163467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:05.175150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765eef0-9123-4d12-8c76-b2badf435330 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.223058 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.224077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.224552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.225044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/7f4ea301b8f046c3b9a7e4737775c5f3/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.228066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=7f4ea301b8f046c3b9a7e4737775c5f3, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.232286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.256413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 292/585] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:05 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/7f4ea301b8f046c3b9a7e4737775c5f3/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:30:05.301326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663bfba-7792-47bd-8feb-54ed823f52bb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.338825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.339486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.339780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.340089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.340720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] RBAC: Adding query filter params (name=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:05.341028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.342420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.347778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 294/586] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:05.355178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:05.440949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:05.488436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abc8e-cf76-47ae-ae41-80f311b4091c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.531458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.532084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.532362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.532635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.533312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] RBAC: Adding query filter params (type=network) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:05.533616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.535001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.542457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 293/587] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:05.548134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:05.605445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:05.689335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e7816-beb1-429d-aa09-88a2dfaed032 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.737256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.738158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.738631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.739039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.739891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] RBAC: Adding query filter params (interface=public, service_id=1703c65c3c944b2a83cd02d797d53d6c, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:05.740333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.741901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4d277-8823-4fb9-8406-14657966bf6c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.752146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 295/588] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:05 2022] GET /identity/v3/endpoints?service_id=1703c65c3c944b2a83cd02d797d53d6c&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:05.758242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:05.905567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed631-4f2b-4400-b513-45f33160c271 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:05.937384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:05.953739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:05.954550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:05.954836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:05.955184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:05.955812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:05.957563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf1a46-2e30-463e-9d67-65bd8dfeaff3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:05.963998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 294/589] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:05 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:06.097339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcccfc-9a12-4b6f-964d-ec1fdceaecba None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:06.097546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcccfc-9a12-4b6f-964d-ec1fdceaecba None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:06.097788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcccfc-9a12-4b6f-964d-ec1fdceaecba None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:06.099366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 296/590] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:06.104889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:06.105205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:06.105465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:06.138830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:06.140300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:06.240267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 295/591] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:06.560671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcccfc-9a12-4b6f-964d-ec1fdceaecba None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:06.711976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcccfc-9a12-4b6f-964d-ec1fdceaecba None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:06.713532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:06.755567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:06.756208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:06.756484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:06.756749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:06.775784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:06.780577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:06.781581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:06.782481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 297/592] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:06.787647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:06.936362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c2008-bdb1-40d5-b42a-9849aa796467 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:06.965750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:06.977574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:06.978618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:06.979326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:06.979587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:06.980448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:06.980797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:06.982266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:06.991001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 296/593] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:06.996541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:07.141432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0448-ced2-41c9-9386-adf5e26136b2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:07.191172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:07.191733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.192009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.192276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.205296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:07.207562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:07.229320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:07.230397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:07.231303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:07.231303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:07.231303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:07.237253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 298/594] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:07.243185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:07.407697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6da44-0ad3-4350-8e9e-563c9955c7d6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:07.457805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:07.458356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.458632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.458895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.459547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:07.459843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:07.461355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:07.473830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 297/595] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:07.479362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:07.516975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:07.611287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e6f92-d021-444a-8f2d-556af7d46820 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:07.656508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:07.657612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.658094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.658560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.667675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:07.669506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-49454a71-ba9d-4c4d-9617-06f3efd5a4e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:07.688567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:07.689693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:07.690655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:07.697328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 299/596] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:30:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:07.702145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:07.713198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b2ad-b650-4839-923e-1c2ff493c019 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.714167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b2ad-b650-4839-923e-1c2ff493c019 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.714639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b2ad-b650-4839-923e-1c2ff493c019 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.716558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 300/597] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:07.722146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9dc-0331-417f-b70e-3c2458911b2f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.722680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9dc-0331-417f-b70e-3c2458911b2f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.723160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0c9dc-0331-417f-b70e-3c2458911b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.753148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d1f0c9dc-0331-417f-b70e-3c2458911b2f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:07.756002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1f0c9dc-0331-417f-b70e-3c2458911b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:07.778278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:07.833105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 301/598] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:07.834791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3718-b1ce-492d-9121-0cbdaaca7d39 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.835326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3718-b1ce-492d-9121-0cbdaaca7d39 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.835809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3718-b1ce-492d-9121-0cbdaaca7d39 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.837129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13828-1014-431f-9c0a-8b7e1dbb3be6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:07.839639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 302/599] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:07.843750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888bd1-137b-45cb-8ff9-d1be56fe3a98 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.844103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888bd1-137b-45cb-8ff9-d1be56fe3a98 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.844450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888bd1-137b-45cb-8ff9-d1be56fe3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.857812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:07.878435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7a888bd1-137b-45cb-8ff9-d1be56fe3a98 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:07.879647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a888bd1-137b-45cb-8ff9-d1be56fe3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:07.880753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:07.881751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:07.882301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:07.882868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:07.883804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:07.884365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:07.886102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:07.921164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 298/600] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 11 06:30:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:07.925080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.011939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 303/601] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:08.042779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315d73-a6a7-4669-a613-6ddc02a0e503 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.042996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315d73-a6a7-4669-a613-6ddc02a0e503 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.043201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315d73-a6a7-4669-a613-6ddc02a0e503 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.044721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 304/602] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:08.049661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.049928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.050199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.074046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:08.075544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:08.081492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab57-e052-407c-8b4a-b5dcb443457a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.085318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.162535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 305/603] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:08.163680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.164299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.164567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.164833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.173657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.296964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.306567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.308048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.346000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcc032-e512-402d-ae54-fcc62f7a5553 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.380185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.380820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.381114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.381377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.382047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.383418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:08.392096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:08.393090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.393986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 306/604] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:08.395333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.436432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 299/605] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 11 06:30:08.437468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.439802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.495909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa9a8f-cb01-4ba5-b3d7-fa5dcf73f6af None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.523454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.533706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.534364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.534633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.535322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.535911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.537469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:08.546440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:08.547505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 06:30:08.553630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.554437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866acd3f-c793-4e3e-a22e-2968bbb0838e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.554537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 307/606] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:08.554537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.603364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.603996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.604266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.604531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.605544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:08.605855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.607272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.612419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 300/607] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:08.613138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.657859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fe33-ee3e-4e50-b01d-1a52b16bf4db None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.685533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.693946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.694653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.694928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.695193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.707330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.708796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.723687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2a10-6df3-4b94-a44d-c6e585e22d78 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:08.724534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:08.726001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:08.727342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:08.727342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:08.727342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:08.727342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 308/608] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:08.727342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.760705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.761362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.761632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.761901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.771176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.771776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:08.777127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:08.778078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:08.778919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 301/609] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:08.779606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.829708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ec402-370e-434a-8cbe-5524f1a306eb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.861898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.862512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.862801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.863043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.863670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:08.863965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.865366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddd244-cc1f-459f-a9c7-59e5b3665d54 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.869624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 309/610] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:08.870743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682d97e-9438-41b3-8a72-417991661466 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.871016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682d97e-9438-41b3-8a72-417991661466 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.871279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682d97e-9438-41b3-8a72-417991661466 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.872445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 310/611] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:08.873145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682d97e-9438-41b3-8a72-417991661466 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.880824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2768a7-bbbb-4883-b46e-6d256e29621e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:08.906755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:08.915567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:08.916174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:08.916447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:08.916716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:08.917379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:08.917674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:08.919054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:08.923519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 302/612] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:08.924273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:08.991804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682d97e-9438-41b3-8a72-417991661466 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.003267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:09.035308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.036103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.036385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.037083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.038041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:09.038388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.039991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.043644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef839b6-7548-4a69-9fea-0eef82472cfc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.052988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 311/613] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:09.053958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.087919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.088488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.088831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.089062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.089818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:09.090116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.091572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8a107-2acc-40ec-81ae-916b8f109fc0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.102910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 303/614] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:09.103556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.103848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.104122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.124501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:09.125790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:09.162583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35caaf-17dd-45aa-af53-c3566a925a90 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.176891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:09.199454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.209060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.209225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 304/615] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:09.209333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.209333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.209511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.209800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:09.209800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.209800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.209800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 312/616] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:09.210572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.244501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:09.372470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045df48b-92be-4319-8f09-90b39f94042a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.395734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb62ba-cea0-4014-80e8-8fb2601aebd7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.437038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.437038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.437038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.437038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.461034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.461034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.473025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.473025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.473025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.473025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.482497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.489030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:09.489186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:09.490037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:09.490914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:09.490914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:09.490914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:09.501035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 313/617] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:09.501201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:09.502050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:09.502924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:09.503362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.503515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 305/618] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:09.503515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.609368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:09.638400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:09.669105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2936-a516-4eae-8cc2-28326c87f962 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.725704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.728568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.728861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.729156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.731336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.732737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.736666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5d11-2517-4e8d-b57b-487b94da411d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:09.776496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 314/619] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:09.776496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.824317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:09.825123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:09.825274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:09.832509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:09.833485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:09.833796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:09.835371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:09.875019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 306/620] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:09.880469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:09.978575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf45e2-3561-47d8-bab2-0d27de8d4cf7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.008564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.014699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808795-597a-450d-952c-6a0128758dcf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.020556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.025054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.034012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.038473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 315/621] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:10.044251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.060187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.061180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.061461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.061729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.062470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.064128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:10.080189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:10.081630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:10.082468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 307/622] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:09 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:10.083267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.145341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc757-0695-41cb-8816-e08b7884a955 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.188175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.188820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.189261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.189531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.198435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.200265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.211584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb650af-5718-464e-b35d-19ef13c1d4d6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:10.215723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:10.217825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 316/623] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:10.220125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.259199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.259726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.260057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.260557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.262247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=026603d0fbbd4770b3cc8564c35ca2dd) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:10.262556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.264046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.272116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 308/624] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/role_assignments?user.id=026603d0fbbd4770b3cc8564c35ca2dd&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:10.272992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.318046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.323955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.404118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6349f-8229-4788-be32-16fe932647bc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.413693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba865b-9232-4cea-bbda-dec27bf5f488 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.457054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.457958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.458535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.459051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.460394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:10.460858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.463141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.481942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.482584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.482861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.483130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.483742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] RBAC: Adding query filter params (name=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:10.484044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.485525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.488666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 309/625] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:10.493269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 317/626] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:10.494841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.498530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.593409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.605886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656b0f-6443-4bef-99f9-1093880739ef None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.620333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22923904-26e0-46e8-9d3f-28eaf0db784d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.645655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.646872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.647355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.647876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.649467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.663727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.663727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.663997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.664203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.664926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:10.665344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.667696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.674391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 318/627] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:10.680378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.760133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.761606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.852072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c276d9-12cd-462b-bed4-87344b3584f1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:10.919240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:10.919849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:10.920118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:10.920380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:10.921304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:10.922695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3df2-637d-488d-81a3-4df3197645c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:10.925888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:10.946682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 310/628] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 11 06:30:10.952272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:10.977688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 319/629] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:11.098846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1766-fb73-4188-b9c0-8cafa16fb00e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.163231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.163873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.164142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.164407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.175168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.176708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.177974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48772-298f-47aa-ac40-4a1e6269ea84 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.178260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48772-298f-47aa-ac40-4a1e6269ea84 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.178533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48772-298f-47aa-ac40-4a1e6269ea84 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.179971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 320/630] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:11.194823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.195191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.195548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:11.198070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:11.199016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:11.199917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:11.199917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:11.199917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:11.199917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 311/631] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:11.206498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:11.234258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:11.235746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:11.244021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:11.319919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:11.351808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350c7f-ec41-48f4-a923-4f3f305c2a10 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.360453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 321/632] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:11.403690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.404312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.404585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.404849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.405523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:11.405816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.407175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.421792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 312/633] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:11.427392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:11.537634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5f6c-aac4-4467-9bff-01f384c19c87 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.582978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.583952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.584445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.584909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.592025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.593722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:11.606179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:11.607052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:11.607948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:11.610320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 322/634] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:11.621068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:11.707370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:11.710657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:11.717356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99118-6e5d-4ef7-9c20-06efcb55c2ac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.752254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:11.757905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.758852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.759895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.760373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.761324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:11.761914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.763683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.777278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 313/635] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:11.783295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:11.828860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99b9d-64ca-4e57-8646-38d7190f1f8c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.864641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.865327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.865559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.865831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.866567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.867950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec9700-8c23-4ab3-8501-4442aafe3ea3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.884665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 323/636] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:11 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:30:11.909397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7166f5-faee-4972-aba4-e7b5d98e955d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:11.956508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:11.957664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:11.958155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:11.958612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:11.959533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=7f4ea301b8f046c3b9a7e4737775c5f3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:11.960183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:11.961938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a42b8f-a351-4ded-a77d-1a60bf93980a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:11.971065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 314/637] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:11 2022] GET /identity/v3/role_assignments?user.id=7f4ea301b8f046c3b9a7e4737775c5f3&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:12.263544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40e2b-b80c-42e9-9996-e93661382443 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.263722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40e2b-b80c-42e9-9996-e93661382443 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.264000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d40e2b-b80c-42e9-9996-e93661382443 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.265686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 324/638] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:12.271079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3efa-0b21-4e0b-b11b-d13683876c0a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.271548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3efa-0b21-4e0b-b11b-d13683876c0a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.271631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3efa-0b21-4e0b-b11b-d13683876c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.290624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f69c3efa-0b21-4e0b-b11b-d13683876c0a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:12.291846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f69c3efa-0b21-4e0b-b11b-d13683876c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:12.300166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:12.369141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 315/639] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:12.630759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d40e2b-b80c-42e9-9996-e93661382443 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:12.738967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:12.749547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d40e2b-b80c-42e9-9996-e93661382443 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:12.787666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:12.788780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.789294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.789761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.790597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:12.792287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:12.802620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:12.803660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:12.804600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:12.812043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 325/640] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:12.813666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:12.814181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29ac4-3b09-4f85-a9df-87e03392be08 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.814524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29ac4-3b09-4f85-a9df-87e03392be08 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.814916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29ac4-3b09-4f85-a9df-87e03392be08 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.816496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 316/641] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:12.822322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.822855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.823196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.843416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:12.844730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:12.928445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3cd7-4386-419a-9773-2508f716f5e2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:12.933135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 317/642] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:12.970859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:12.971862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:12.972338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:12.972866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:12.973719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:12.974234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:12.975874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:12.985814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 326/643] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:12.987397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:13.058243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:13.093715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093fc5c-57eb-43cd-8e11-73f705db47e3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:13.128071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:13.128919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:13.129387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:13.129800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:13.130565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:13.131025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:13.132586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:13.137660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 318/644] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:13.234722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:13.262083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:13.346038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aae7a-7753-487a-a95f-c9b434d4aacf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:13.381316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:13.382008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:13.382284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:13.382552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:13.393050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:13.397970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:13.398880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:13.399698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 327/645] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:30:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:13.405387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:13.512196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb08d6-fffd-4f07-92d5-fe3cf2ed6c85 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:13.546491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:13.547506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:13.547972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:13.548444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:13.549317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:13.549806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:13.551369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:13.553899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:13.569022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 319/646] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 11 06:30:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:13.574796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:13.670935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:13.685557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fd0cb-3d98-406f-9036-0bf433cf8723 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:13.722058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:13.723058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:13.723533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:13.724014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:13.734869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:13.736651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:13.751714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:13.752686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:13.753636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:13.753636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:13.753636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:13.755728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 328/647] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:13.761704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:13.867125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f316b4-b471-4958-8850-029098dd3e6c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:13.903695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:13.904704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:13.905229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:13.905692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:13.906528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:13.907019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:13.908568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9ca7e-4c4b-4594-8967-88b831a1c32f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:13.921172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 320/648] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:13.927027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.034049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f9b66-3f11-4b69-9434-d186ce3397d3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.066188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7654-08a3-487d-a90a-d96b0f742fbd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.066538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7654-08a3-487d-a90a-d96b0f742fbd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.066721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7654-08a3-487d-a90a-d96b0f742fbd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.068290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 321/649] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:14.072353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.073488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.073976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.074273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0de557-d242-4202-9195-5eabe0fde620 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.074547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0de557-d242-4202-9195-5eabe0fde620 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.074819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0de557-d242-4202-9195-5eabe0fde620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.075086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.077949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.087112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.088608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.094563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fb0de557-d242-4202-9195-5eabe0fde620 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:14.095810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fb0de557-d242-4202-9195-5eabe0fde620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:14.101822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:14.102767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:14.104109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 329/650] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:30:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:14.108840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.154667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.181437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 322/651] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:14.222936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdb5c6-e973-40dc-b888-9880442b3981 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.256401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.257075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.257349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.257614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.258352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:14.258650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.260069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.262428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576910-352a-422d-801e-867e5bc0c576 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.262944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576910-352a-422d-801e-867e5bc0c576 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.263436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576910-352a-422d-801e-867e5bc0c576 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.265267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 323/652] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:14.270799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.271291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.271744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.278541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 330/653] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:14.284067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.293046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:14.294252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:14.346809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.363424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 324/654] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:14 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:14.397159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ad2c-7c72-4d1d-a594-25baf3e4acb0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.430947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.431898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.432327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.432729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.443044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.444721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.455527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:14.460681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:14.461827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:14.462913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:14.462913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:14.462913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:14.464573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 331/655] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:14.469856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.573625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f621e-da27-4760-b5d4-c849e08978ad None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.576218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.580694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fa61-2cda-4786-aa7b-fa52536062a1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.602563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.615527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.616163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.616439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.616761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.617587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:14.617891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.619799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.623807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.624669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.625219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.625682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.626453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.628169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.632359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 332/656] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:14.633196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:14.637818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:14.638723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:14.639596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:14.641597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 325/657] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:14.642504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.737766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f17ed-1949-451f-9168-5af5bdedb891 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.748819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0254-f458-415d-bb7f-cccfdc1dd4c1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.772940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.773603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.773987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.774254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.774952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.776336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.781829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.782453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.782722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.782985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:14.785619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:14.786557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:14.790057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 333/658] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:14.790873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.790941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.791020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:14.802774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:14.805492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 326/659] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:14.806387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.827244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.853602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:14.911698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e217-d47b-4709-9d04-6a3356fbf98e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.930958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36feb76-44a8-48e4-ba50-4e68f617e618 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:14.954948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.955810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.956544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.956894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.957873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:14.958267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.960451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.969175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 334/660] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:14.970050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:14.976701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:14.977355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:14.977631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:14.977893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:14.978516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:14.978813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:14.980611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:14.988000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 327/661] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:14.988773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.083365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:15.094095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89e3c0-40c8-4497-9780-c2de8986828e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.117372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667c1a7-372c-4660-88c1-d5acba203555 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.127574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:15.154588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.155512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.155957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.156459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.157584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:15.158062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.159657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.176388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 335/662] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:15.177285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.178304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.178995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.179252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.179515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.180144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:15.180442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.181839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.190548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 328/663] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:15.191385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.318954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bbbb1-0e94-4f34-aedb-0824623c07e4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.321160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe501b6a-3b81-46af-b08e-4e199861bb5f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.360860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.361908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.362258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.362619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.363676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:15.364098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.364983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.365858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.365997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.366199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.366432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/026603d0fbbd4770b3cc8564c35ca2dd/roles/69b48bae4d894c849f19cbf3f4023171` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.369130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=026603d0fbbd4770b3cc8564c35ca2dd, role_id=69b48bae4d894c849f19cbf3f4023171)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.370815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2873e2-4d43-415f-9e12-2c0c962435d0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.377184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 336/664] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:15.377184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.392941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 329/665] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:15 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/026603d0fbbd4770b3cc8564c35ca2dd/roles/69b48bae4d894c849f19cbf3f4023171 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:30:15.394752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517cfc-74d4-4d9d-b485-a0c297d9f5ad None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.395046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517cfc-74d4-4d9d-b485-a0c297d9f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.395316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517cfc-74d4-4d9d-b485-a0c297d9f5ad None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.397108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 330/666] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:15.403261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.403548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.403822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.405514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:15.426974 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:15.428946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:15.461178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:15.533131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 331/667] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:15.538367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461c1-0293-4f2e-9f58-3c6a93bf7edd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.601434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.601768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.602483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.602483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.603553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] RBAC: Adding query filter params (interface=public, service_id=f4596b3d14944a6aa38f8c4da91a1e85, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:15.603553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.605304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.610672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 337/668] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:15 2022] GET /identity/v3/endpoints?service_id=f4596b3d14944a6aa38f8c4da91a1e85&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:15.619149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.724091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c836-52bb-40d3-9abf-87ca12791e92 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.759129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.759756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.761029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.761029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.761029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.762294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067a1f9-16d3-4b1a-a801-1ca566614e95 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.768305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 332/669] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:15 2022] GET /identity/v3/services => generated 1029 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:30:15.817544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:15.915570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:15.939587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856e8b7-0d4d-4a68-9974-1fc7369926d7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:15.976606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:15.977258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:15.977582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:15.977844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:15.978541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:15.979924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59a93a-8a36-410e-a24b-949a1f1a2804 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:15.998348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 338/670] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:15 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:17.614376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3736f-4861-4852-8bb0-77be61fb2959 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:17.614901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3736f-4861-4852-8bb0-77be61fb2959 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:17.614901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3736f-4861-4852-8bb0-77be61fb2959 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:17.616438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 333/671] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:17.617664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742afc-59dc-4694-9bfa-1cce889832d1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:17.618059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742afc-59dc-4694-9bfa-1cce889832d1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:17.618230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742afc-59dc-4694-9bfa-1cce889832d1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:17.619726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 339/672] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:17.622613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:17.622885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:17.623155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:17.624709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:17.624986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:17.625283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:17.643872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:17.645182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:17.651302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:17.652724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:17.672621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:17.737023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 334/674] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:17.737369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 340/674] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:17.995788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.001845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.070665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.097792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d665592-ea8e-4181-8520-45ff9c854c51 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.114163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02058df-2efb-49a0-b833-5c06e09ac6fe None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.136131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.136762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.137057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.137737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.137977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.139402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9729707-47ea-4688-906a-c509b2205ee4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.155512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.156174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.156456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.156722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.165115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 335/675] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:17 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:18.165115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c04-f50d-4559-aae5-f045457fe207 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.165115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c04-f50d-4559-aae5-f045457fe207 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.165115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c04-f50d-4559-aae5-f045457fe207 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.165115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 336/676] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:18.169878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f538b5-1104-4b84-b16f-7c22e613c13a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.170231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f538b5-1104-4b84-b16f-7c22e613c13a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.170407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f538b5-1104-4b84-b16f-7c22e613c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.180094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:18.186270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:18.187328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:18.188768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:18.190658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c9f538b5-1104-4b84-b16f-7c22e613c13a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:18.191877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c9f538b5-1104-4b84-b16f-7c22e613c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:18.192808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 341/677] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:18.196592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.198730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.296481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 337/678] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:18.298775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb77b-ce68-4a2e-8b6a-39dfa5d38469 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.299209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb77b-ce68-4a2e-8b6a-39dfa5d38469 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.299899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb77b-ce68-4a2e-8b6a-39dfa5d38469 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.302580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 338/679] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:18.308942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.309592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.310509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.316717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b683a8-3d8d-4866-b98d-417f7da74bbe None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.340669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:18.342513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:18.347208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.356948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.358399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.358670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.359252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.359657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:18.359956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.361586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.372120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 342/680] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:18.377686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.432344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 339/681] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:18.490680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dd4c3-d806-4222-9a32-fc6ab6398305 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.526045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.527179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.527599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.528034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.540902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.542572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:18.558621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:18.559601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:18.560501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:18.560501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:18.560501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:18.562258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 343/682] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:18.572340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.575851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.634715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.673967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.709882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dbc8-3d43-4281-bb73-d2490b0aba23 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.710604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f01fd-48ab-4055-937e-4db0ab49465a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.747316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.747955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.748233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.748390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.748497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.748973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.749143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.749343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.749613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.750248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:18.750488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.750578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.751870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:18.759302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:18.760299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.761249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 340/683] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:18.762069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.774526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 344/684] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:18.774526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.869310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49c61-c48c-4083-a417-8f1d3a83f562 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.873066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.877035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d39e3b-fb6c-476a-bc9b-7f266d9db541 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:18.901751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:18.908044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.908744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.909041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.909312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.909896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.911270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:18.920357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:18.921378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:18.922192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 341/685] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:18.922963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:18.923913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:18.924533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:18.924805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:18.925103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:18.925734 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:18.926032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:18.927809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:18.933318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 345/686] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:18.934049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.030305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641c0b-07f9-4a9f-8398-80ed959adaeb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.046107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637e66f-f772-493d-a03b-bdf36dc77486 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.064320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.064947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.065240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.065504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.072822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.074290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.080044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.080647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.080924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.081579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.082202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:19.082494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.083839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:19.087510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:19.088605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 06:30:19.089745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:19.091857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 342/687] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:19.092809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.093154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 346/688] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:19.098080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.132691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.156698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.205020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd97560-1269-4636-9133-4d100983cfc8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.205233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea751c-ab4f-4383-95af-6d14ababaf55 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.240870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.241637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.242015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.242311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.243002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:19.243784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.244386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.244860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.244979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:19.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.249918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 343/689] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:19.250745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.261893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 347/690] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:19.261893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.355153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbc69a-1aa3-4548-b13c-c9849bf27118 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.357069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.368135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2f30-36f4-4a6d-aa7e-bbe014bba005 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.374321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.393182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.393765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.394035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.394287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.395026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:19.395318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.396984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.404087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.404727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.405017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.405317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.405956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.407291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.420442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 344/691] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:19.420442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.433279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 348/692] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:19.445232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.574631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f78d-3f8b-40d4-8cd2-3365724bd722 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.579332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d188ae-5c2e-4f6d-81a2-d7460eea1202 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.622714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.623602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.623879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.624144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.626930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.627543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.627816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.628080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.628787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] RBAC: Adding query filter params (interface=public, service_id=90fcacf6422a4c79a662260ab10e7069, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:19.629823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.630503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.639365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 345/693] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/endpoints?service_id=90fcacf6422a4c79a662260ab10e7069&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:19.644577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.646456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.704599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.714916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.716411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.784155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c1d84-e250-4682-9584-5cb857b6d635 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:19.828579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:19.829888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:19.830769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:19.831932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:19.833037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:19.835443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:19.842402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 349/694] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:30:19.843810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 346/695] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:30:19.850209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:19.908768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:19.978940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b1787-1768-403b-b570-4504f4219891 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:20.027103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:20.027768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:20.028035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:20.029055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:20.043035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:20.044493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b8fe8a83-fea9-4587-b8dd-ccb262f8c42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:20.060275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:20.061326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:20.062215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:20.062215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:20.062215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:20.062215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 350/696] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:20.067927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:20.434765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdf46-fb17-4cb7-8f6c-8182c7e493e1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:20.441046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32309-6fe7-4b3a-b679-94da9b510a44 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:20.441323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32309-6fe7-4b3a-b679-94da9b510a44 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:20.441591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32309-6fe7-4b3a-b679-94da9b510a44 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:20.442655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:20.446910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 351/697] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:20.448409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:20.448696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:20.448984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:20.477023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:20.479204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:20.577020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:20.577020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:20.577020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:20.577020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:20.577371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:20.577371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:20.577371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:20.578166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 352/698] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:20.590468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 347/699] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:20.596837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:20.663344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:20.783947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f2e6-70c9-4e57-9a43-a369ba186457 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:20.819743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:20.820383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:20.820660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:20.820929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:20.827907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:20.829389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:20.841207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:20.842063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:20.842931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:20.847185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 353/700] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:20.848577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:20.961041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:21.057098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594ca81-5078-4ced-9b75-6afe2c89d627 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.129026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.129026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.129026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.129026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.129438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:21.129438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.129438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.134676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:21.155501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec21ba-868c-4a38-a36d-6a1e24704fbb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.167668 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 348/701] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:21.168796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:21.200657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.201518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.201884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.202320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.203165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.204668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:21.219610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:21.220624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:21.221517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 354/702] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:21.230284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:21.266390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:21.507274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43951ec-71d0-43fb-b2fd-3d8db6479fa2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.566656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.570617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.571343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.571773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.572651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] RBAC: Adding query filter params (role.id=69b48bae4d894c849f19cbf3f4023171, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=026603d0fbbd4770b3cc8564c35ca2dd) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:21.573119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.574997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.575969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbc7a1-63d4-4b95-9612-061627742a63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.583689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 349/703] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:21 2022] GET /identity/v3/role_assignments?user.id=026603d0fbbd4770b3cc8564c35ca2dd&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=69b48bae4d894c849f19cbf3f4023171 => generated 608 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:21.621329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.621966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.622238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.622505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.623157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:21.623455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.624907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.630971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 355/704] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:21.636630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:21.750883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:21.764959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f051c7-2423-440a-b29b-bfc55d338a93 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.802240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.802865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.809022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.809022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.809022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:21.809022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.809022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f074e5-1bc4-4c23-b2d0-4ec3b95a9a6c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.812573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 350/705] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:21.818947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:21.838359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b806c-2047-42c2-8b76-b466b0c59bf5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.838651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b806c-2047-42c2-8b76-b466b0c59bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.838924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b806c-2047-42c2-8b76-b466b0c59bf5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.840596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 351/706] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:21.846094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.846365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.846635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.849400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:21.871459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:21.873577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:21.948774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34e08e-3390-4d09-a040-2b16f31ba410 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:21.965366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 352/707] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:21.988677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:21.989759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:21.990292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:21.990753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:21.991747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] RBAC: Adding query filter params (interface=public, service_id=0c248ef53e7c4fe398c8904ab36ccaed, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:21.992276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:21.993891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:21.999808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 356/708] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:21 2022] GET /identity/v3/endpoints?service_id=0c248ef53e7c4fe398c8904ab36ccaed&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:22.005985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.103356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:22.112701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194c95-ae74-4684-a682-352d50e5eb8b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:22.155319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:22.155972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.156243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.156509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.157183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:22.158586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb66161-803e-4832-a42d-ffefccc2e60f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:22.165877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 353/709] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:30:22.241355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.266760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1a21-5d28-40e0-b401-5fb8c3f26d36 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.267101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1a21-5d28-40e0-b401-5fb8c3f26d36 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.267384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1a21-5d28-40e0-b401-5fb8c3f26d36 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.269113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 354/710] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:22.275028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.275372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.278400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.295135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:22.296354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:22.336352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:22.361907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c0d5-65ff-4631-bbac-a56cc7b30b33 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:22.372465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 355/711] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:22.400908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:22.401598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.401846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.402115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.402703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:22.404045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:22.412976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:22.413980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:22.414820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:22.415575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 357/712] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:22.421024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.501368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:22.521959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef56a7-f9cc-4975-ac04-e3fe8c7c8e30 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:22.565155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:22.565786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.566062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.566331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.567047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:22.567345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:22.571000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:22.574228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 356/713] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:22.579762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.652204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.684525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bbc4-d1fb-4fc5-9213-45c61f648643 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:22.723450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:22.724061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.724332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.724594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.725271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:22.725571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:22.726924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:22.737232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 358/714] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:22.789244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20bca7-aba0-4970-86ce-668ef3a0897f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:22.834672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:22.835725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:22.836292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:22.836813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:22.837689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:22.839293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:22.849522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:22.850666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 06:30:22.851520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:22.859245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 357/715] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:22.861118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:22.872457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:22.982288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a29ed7-9cbe-4708-8c4f-4cbae760dd55 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:23.017471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:23.018083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:23.018355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:23.018622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:23.019245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:23.019545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:23.020911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:23.026137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 359/716] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:23.031959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:23.037057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:23.149301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc42c77-ee2e-4190-986e-abfb530d9942 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:23.189092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:23.190115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:23.190878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:23.191350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:23.192173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:23.192745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:23.194383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954ae14-fe50-4b6f-af27-a99b89b3f746 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:23.204572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 358/717] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 11 06:30:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:23.206579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:23.289422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:23.316339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d53829-3a93-480c-b549-9ad043f161b4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:23.351296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:23.351924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:23.352206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:23.352483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:23.353202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:23.354597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eae88-9f36-4e5d-82f2-fdd8d568c72a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:23.381163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 360/718] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:23.872649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f4ec-c95d-4a3a-b053-1abcdc78ef97 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:23.873045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f4ec-c95d-4a3a-b053-1abcdc78ef97 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:23.873246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f4ec-c95d-4a3a-b053-1abcdc78ef97 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:23.874718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 359/719] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:23.883596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c84f-aabf-4048-9e26-63eaaa1d1ac6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:23.883596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c84f-aabf-4048-9e26-63eaaa1d1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:23.883596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c84f-aabf-4048-9e26-63eaaa1d1ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:23.900671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0d29c84f-aabf-4048-9e26-63eaaa1d1ac6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:23.902235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0d29c84f-aabf-4048-9e26-63eaaa1d1ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:23.981893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 361/720] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:24.256247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449f4ec-c95d-4a3a-b053-1abcdc78ef97 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:24.353509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:24.375587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449f4ec-c95d-4a3a-b053-1abcdc78ef97 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:24.410958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:24.411587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.411856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.412119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.412367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626551e-ddad-4b3c-a71d-5e75138ad645 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.412693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626551e-ddad-4b3c-a71d-5e75138ad645 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.412834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:24.412990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626551e-ddad-4b3c-a71d-5e75138ad645 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.414151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:24.414626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 362/721] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:24.419603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.419887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.420166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:24.424249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:24.425251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.426092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 360/722] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 11 06:30:24 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:24.432865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:24.444617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:24.445965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:24.503723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:24.533396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 363/723] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:24.564963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b8d0d-00b4-4435-bbe0-180c44d5cd72 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:24.597030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:24.601758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:24.602612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.602919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.603260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.604154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:24.604945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:24.606540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:24.611802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 361/724] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:24.617300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:24.719690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf1a9a-f1ae-49cb-b951-9660d5257c1c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:24.753380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:24.753989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.754259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.754520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.755139 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:24.755431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:24.756827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:24.761777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 364/725] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:24.804238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:24.925623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5176-e3b9-462c-a959-74aa8fc1b100 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:24.966329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:24.967028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:24.967315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:24.967585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:24.968176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:24.969604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6b8fbb5e-3dae-44d6-82fb-c72eaed55bfc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:24.978934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:24.981199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:24.983146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 362/726] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:24.987769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:25.006000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc94a2-9801-423c-8085-6e1e6a118b7b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.006628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc94a2-9801-423c-8085-6e1e6a118b7b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.007094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc94a2-9801-423c-8085-6e1e6a118b7b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.008970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 363/727] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:25.014263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.014546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.014818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.034021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:25.035116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:25.046527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:25.097912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:25.111252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba7353-d1e4-480d-9d71-efdfe586d64c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:25.129255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 364/728] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:25.146219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:25.146843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.147168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.147439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.148071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:25.148372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:25.149797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:25.154952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 365/729] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:25.160419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:25.267058 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff5ef9-07cb-4ffb-83d2-962b578848ec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:25.303070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:25.304096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.304594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.305110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.305952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:25.306459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:25.308023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:25.313818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 365/730] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:25.319803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:25.417617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:25.428697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fca6d8-c5af-45fc-937c-44f5409d83da None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:25.439820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:25.469162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:25.469776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.470044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.470318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.471131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:25.473180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28363878-c1af-4d1d-b3d9-70ef630af1bb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:25.497413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 366/731] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:25.517660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:25.568612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031604c7-15eb-4426-a460-b4e046a6f5f5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:25.621093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:25.621928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.622293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.622651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.623432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:25.625044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1048-c397-410b-90a5-fd721746def0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:25.649279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 366/732] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:25 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:30:25.696182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fdb9-35ad-44d8-bf9c-8829350a9734 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.696372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fdb9-35ad-44d8-bf9c-8829350a9734 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.696675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fdb9-35ad-44d8-bf9c-8829350a9734 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.698622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 367/733] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:25.705066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:25.705617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:25.706416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:25.727517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:25.729038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:25.825511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 367/734] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:26.093716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fdb9-35ad-44d8-bf9c-8829350a9734 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:26.203238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fdb9-35ad-44d8-bf9c-8829350a9734 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:26.240409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:26.241097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:26.242948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:26.243220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:26.243901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:26.245364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:26.247988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING keystone.server.flask.common [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 11 06:30:26.269223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:26.269223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:30:26.269223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [parameters: {'id': 'ee1539e3f62540c6ac5d0bea5836f7e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 06:30:26.269223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1539e3f62540c6ac5d0bea5836f7e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1539e3f62540c6ac5d0bea5836f7e9. Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:26.276606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 06:30:26.277442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Oct 11 06:30:26.278404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 06:30:26.279323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 06:30:26.280240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:26.281927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'id': 'ee1539e3f62540c6ac5d0bea5836f7e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:26.284053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:26.285933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1539e3f62540c6ac5d0bea5836f7e9. Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:26.294711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 368/735] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Oct 11 06:30:26 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:26.296309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:26.333193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:26.416203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27584-9c6d-4ef1-ac46-67c999ee466c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:26.452520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:26.453596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:26.454075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:26.454539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:26.463012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:26.464717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ae7d925f-cbdb-40d9-a417-8ac911b2269f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:26.478266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:26.479195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:26.480102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:26.482618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 368/736] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:26.493387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:26.522562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:26.607815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb9ec-e987-48bb-832d-a1e95c2d2a0b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:26.643295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:26.644274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:26.644757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:26.645263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:26.646124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:26.646641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:26.648574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1421aa-393b-43dc-a56a-adf2efaa527a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:26.669168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 369/737] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:27.003998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0093-2d2a-4aad-92fa-642eb5fd9ba5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.004175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0093-2d2a-4aad-92fa-642eb5fd9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.004456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0093-2d2a-4aad-92fa-642eb5fd9ba5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.006113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 369/738] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:27.011489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484633d-739f-4d2e-8f67-eadc0ce57bcc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.011775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484633d-739f-4d2e-8f67-eadc0ce57bcc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.012043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484633d-739f-4d2e-8f67-eadc0ce57bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.030688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2484633d-739f-4d2e-8f67-eadc0ce57bcc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:27.032176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2484633d-739f-4d2e-8f67-eadc0ce57bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:27.100544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 370/739] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:27.370413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0093-2d2a-4aad-92fa-642eb5fd9ba5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:27.470898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:27.479139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0093-2d2a-4aad-92fa-642eb5fd9ba5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:27.515494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:27.516468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.516934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.517413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.518413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:27.520033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62179619-675a-4bb5-b490-a9e3548efde8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:27.540560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 370/740] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:27 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:27.842086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d009-e20d-49f9-9c3a-787ba0506086 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.842760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d009-e20d-49f9-9c3a-787ba0506086 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.843256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d009-e20d-49f9-9c3a-787ba0506086 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.845068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 371/741] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:27.850355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.850636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.850906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.869340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:27.870522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:27.872741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84202b-ae3f-4f47-8efe-75be8c701c74 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.873051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84202b-ae3f-4f47-8efe-75be8c701c74 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.873329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84202b-ae3f-4f47-8efe-75be8c701c74 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.874920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 372/742] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:27.879845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:27.880127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:27.880400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:27.898788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:27.899988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:27.908026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:27.965102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 371/743] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:27.984858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 373/744] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:28.236930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.257601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.336980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.363203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14277-9604-40f2-a0d7-d267b4cd02d1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.372257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2858e36-d8f6-4c56-8288-6fffcaa3543d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.406116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.406785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.407022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.407280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.407873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.409283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.411418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.412359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.412883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.413382 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.414154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.415772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:28.418417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:28.419370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:28.425405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 372/745] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:28.427807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:28.427995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:28.428965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:28.433893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 374/746] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:28.443459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.453408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.544247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9c75-b230-4d23-8f2b-523bfb5e9d60 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.556663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4041c1-ca4b-44d0-b3c7-2d7b64234f10 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.581286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.581286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.581286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.581286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.585022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.585022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.589028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.593043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 373/747] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:28.599256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.604983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.605849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.606325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.606776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.607581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.608051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.610159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.613871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.617755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 375/748] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:28.623781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.705306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.715368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c05be-a095-4acf-8751-3f9c50e41cd0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.745964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d861c0f-231f-4481-b0eb-6f1cba67daf5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.752010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.753078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.753636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.754111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.755036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.755553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.757306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.763090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 374/749] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:28.768594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.781079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.781697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.781966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.782234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.783045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.783263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.784626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.790910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 376/750] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:28.796720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.868738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.896864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346cebd-c501-4b47-8783-51056ea14903 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.932199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f7ed9-320a-4ad0-a691-9a0324e26de5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:28.940526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.941610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.942106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.942571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.943605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] RBAC: Adding query filter params (interface=admin, service_id=0c248ef53e7c4fe398c8904ab36ccaed, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.944182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.945876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.952468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 375/751] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/endpoints?service_id=0c248ef53e7c4fe398c8904ab36ccaed&interface=admin®ion_id=RegionOne => generated 193 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:28.959194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:28.974647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:28.975826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:28.976720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:28.977372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:28.978326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] RBAC: Adding query filter params (interface=public, service_id=ac29a31bea8643979c40d6cfad2a1f56, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:28.978949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:28.980804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:28.982933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:28.990060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 377/752] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/endpoints?service_id=ac29a31bea8643979c40d6cfad2a1f56&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:28.996101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:29.071724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c14433-ad42-46a5-8161-433a0fb2e3c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:29.105427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:29.105695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39724b14-1ce5-4210-8ee7-c770311b821b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:29.106200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.106534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.106861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.107688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:29.109882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883bbd9-842f-4b13-8d5b-01f11848015b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:29.122799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 376/753] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:30:29.122799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef0a8-8d6c-4678-b857-8461f0dde114 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.122799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef0a8-8d6c-4678-b857-8461f0dde114 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.122799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ef0a8-8d6c-4678-b857-8461f0dde114 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.132101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 377/754] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:29.132101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.132101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.132101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.137141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:29.152294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:29.153049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.153331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.153600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.153817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:29.154216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:29.155224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:29.155613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:29.163868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 378/755] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:28 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:30:29.241923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 378/756] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:29.519453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:29.584707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:29.625538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c215f8-9d8e-4cb0-90ae-3a18258882a3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:29.660291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:29.660948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.661259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.661527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.662201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:29.663788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:29.680389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 06:30:29.680389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 06:30:29.680389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [parameters: {'user_id': '8eb912222d2b454683014610cea3f288', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 06:30:29.680389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8525cded-c8d8-4b33-b084-006dc1894435 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:29.688181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:29.689180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 06:30:29.690569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 06:30:29.691695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:29.692612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:29.693482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'user_id': '8eb912222d2b454683014610cea3f288', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:29.694455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 11 06:30:29.697744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:29.704088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 379/757] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 11 06:30:29 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:29.704992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:29.789119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf507bf-f184-41be-afdf-1589adc568e5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.789119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf507bf-f184-41be-afdf-1589adc568e5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.789119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf507bf-f184-41be-afdf-1589adc568e5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.796252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 380/758] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:29.798150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.798651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.799112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.812801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ade98-e48e-4818-b0c2-406a1450a5ea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:29.823257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:29.825381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:29.843243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:29.852926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:29.853762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:29.854038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:29.854303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:29.862267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:29.863717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:29.876254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:29.877283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:29.878664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 379/759] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:29.883310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:29.913148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 381/760] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:29.990469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d52c-e15e-4aff-bc2e-dd32b80ffa51 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.024972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.025749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.026148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.026511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.027313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:30.027708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.029262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.068779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 380/761] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 11 06:30:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:30.194934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:30.255575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:30.304920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae029e2-83fc-4bc4-81fb-f1e2b3efa68e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.341292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.341847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.342115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.342376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] PATH_INFO: `/v3/services/image` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.342953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.344447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:30.353546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:30.354575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:30.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:30.359119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 382/762] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 11 06:30:30 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:30.361210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:30.419526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:30.471106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824405b7-5d34-4c58-a1e2-52542d71ecc2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.510428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.511047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.511345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.511611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.512235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:30.512528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.513989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.519200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 381/763] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:30.525031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:30.637639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6fe7-94b5-449f-9bfb-7c6e799bba61 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.654978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:30.673561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.674171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.674447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.674714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.675342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:30.675638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.677012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.686889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 383/764] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:30.688393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:30.788262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cab7e1-416a-43af-9a54-577c25e5b581 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.804051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:30.826836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.827457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.827733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.827964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.828694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] RBAC: Adding query filter params (interface=public, service_id=0fe6af2cf6ac4e03b843e0a10cdd29ff, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:30.829015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.830405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522c3d-4c4f-49f0-a774-ee15f66f3125 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.836393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 382/765] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:30:30 2022] GET /identity/v3/endpoints?service_id=0fe6af2cf6ac4e03b843e0a10cdd29ff&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:30.842019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:30.949107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188a675-7e83-462b-b43b-a3ae2558562b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:30.983004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:30.983617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:30.983890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:30.984153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:30.984754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:30.986148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c77f-d752-4e60-8d73-d3290cd9825a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:30.993024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 384/766] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:30:30 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:30:31.392919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c5e-de1c-4253-b16c-97eb9782db13 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.393324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c5e-de1c-4253-b16c-97eb9782db13 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.393523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a4c5e-de1c-4253-b16c-97eb9782db13 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.394917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 383/767] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:31.400293 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.400576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.400850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.409326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883e9b1-ada9-4658-a8db-6f0102c17522 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.409610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883e9b1-ada9-4658-a8db-6f0102c17522 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.409884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883e9b1-ada9-4658-a8db-6f0102c17522 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.411320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 384/768] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:31.416192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.416440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.416713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.420868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:31.422122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:31.434582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:31.435763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:31.483571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:31.507898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 385/769] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:31.523350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 385/770] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:31.769361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:31.777411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:31.878683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b17bc-3500-4314-8a02-9ae81f09c0b9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:31.886898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380cbf-0afe-4697-9415-70fe7face9b2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:31.889396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:31.917520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:31.918153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.918441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.918700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.919293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:31.920652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:31.923283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:31.923975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:31.924319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:31.924658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:31.925353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:31.926780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:31.930338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:31.931484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:31.932348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 386/771] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 11 06:30:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:31.937323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:31.938980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:31.939921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:31.940742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 386/772] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:31.946182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:31.991413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:32.050068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ea6bc-4e26-4d41-a082-f39958287968 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.055229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714864-00a8-436e-a545-705439fe2f78 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.090401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.091128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.091406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.091678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.091958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.092309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:32.092568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.092665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.092843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.093133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.093754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:32.094012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.094106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.095555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.099006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 387/773] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:32.106067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 387/774] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:32.106694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:32.106878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:32.144690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:32.216070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0a5b-a115-4f3b-9178-dac14a4d59cd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.216831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7f7c6-2557-4f34-bcf6-317ff5b33136 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.219135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:32.251429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.251967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.252098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.252294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.252555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.253161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.253273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:32.253489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.253801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.254203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.254836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.255132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:32.255561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.257108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.259645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 388/775] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 11 06:30:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:32.265290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:32.266999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 388/776] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 11 06:30:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:32.273870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:32.373058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af5c93-f89d-4036-85c8-e0c86d8903b1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.376432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:32.379477 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca688eba-2c9b-40e0-bc39-8cb843f0894e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:32.412021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.412655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.412924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.413219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.413865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.415263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c6536-67c0-4225-8c44-9cbd8a70a84f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.416572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:32.417495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:32.417793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:32.418062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:32.418741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:32.420098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b9e60-bf23-4a97-a71c-6b6eb62d23ad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:32.436519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 389/777] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:30:32.447183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 389/778] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:30:33.148863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0035-129e-4d22-99df-db556b232578 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:33.148863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0035-129e-4d22-99df-db556b232578 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:33.148863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea0035-129e-4d22-99df-db556b232578 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:33.148863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 390/779] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:33.154376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:33.154789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:33.154956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:33.173592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:33.174623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:33.251318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 390/780] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:33.513505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0035-129e-4d22-99df-db556b232578 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:33.540108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:33.628125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea0035-129e-4d22-99df-db556b232578 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:33.663468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:33.664105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:33.664376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:33.664637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] PATH_INFO: `/v3/services/image` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:33.665241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:33.666612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:33.675363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:33.676325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:33.677291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 391/781] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 11 06:30:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:33.683587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:33.768130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:33.784806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cada6-b88c-4c30-a686-01703437ce8a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:33.942428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:33.943409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:33.943917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:33.944406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:33.945289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:33.945783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:33.947329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:33.953041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 391/782] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:33.959230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:34.053336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:34.066308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9ae05-e834-436b-a9f4-6e9619c544ef None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:34.103027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:34.103650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.103922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.104187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.104821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:34.105157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:34.107222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5272-98db-440c-8295-487dc9b257b2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:34.113875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 392/783] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:34.119792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:34.227883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed808-e2a1-4a38-9366-598e50ec43ec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:34.263454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:34.264070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.264340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.264602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.265306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:34.266941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498169-deca-4bdd-8a1a-eb57abe337c2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:34.293043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 392/784] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:30:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:34.656480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e2e7-96fe-40dd-a21e-1f4978cf7fb4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.657059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e2e7-96fe-40dd-a21e-1f4978cf7fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.657059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e2e7-96fe-40dd-a21e-1f4978cf7fb4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.658553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 393/785] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:34.664201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.664488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.664757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.678598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:34.684524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:34.686491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:34.689983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be75cf2-1f82-47d5-b9eb-b9ab8751101a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.690267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be75cf2-1f82-47d5-b9eb-b9ab8751101a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.690543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be75cf2-1f82-47d5-b9eb-b9ab8751101a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.692048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 394/786] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:34.697029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:34.697338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:34.697609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:34.718730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:34.720134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:34.762356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 393/787] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:34.796064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 395/788] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:35.023458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.071811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.132679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca8e36-d781-4072-b701-15e8722c554d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.157105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:35.166276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:35.172745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.173773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.174068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.175545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.176865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.178636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.181040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 394/789] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:35.183166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a2ea-f112-440b-b135-d04cfb338442 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.186579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.220368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.221061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.221317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.221579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.232394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:35.240371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:35.241463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:35.245778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 396/790] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:35.248039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.300020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9310c-c400-4156-be41-428e50e9b096 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.333688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.334352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.334633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.334902 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.335554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.336992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.355993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df766e0-789e-432d-85d8-fc8b3709f1ee None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.366059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 395/791] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:35 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:30:35.399471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.400461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.400916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.401420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.402579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:35.403266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.404957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.420742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 397/792] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:35.422828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.483565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:35.541967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d06d-8b6b-48db-a239-d774a2203ce2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.580447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.581501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.581769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.582041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.593394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.594850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:35.610378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:35.611590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:35.612825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:35.612825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:35.612825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:35.612825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 396/793] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:35.619403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.623650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:35.724596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3948c26-b1a4-454f-bfbd-ea11e49a70bc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.759391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.759999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.760278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.760528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.761192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:35.761540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.762902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.774944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 398/794] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:35.780468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:35.880382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d213-9b0a-48f0-b9ad-56fbb7954e87 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:35.882813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:35.917287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:35.917918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:35.918183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:35.918448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:35.927652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:35.928344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:35.940237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:35.941447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:35.942392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 397/795] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:35.948985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.013754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:36.055375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65497a-89ca-4ab9-9a2d-d77556ef9e20 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.089550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830128-2792-45f8-9cf2-62360166801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:36.090156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830128-2792-45f8-9cf2-62360166801f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.090428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830128-2792-45f8-9cf2-62360166801f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.090687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91830128-2792-45f8-9cf2-62360166801f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.091405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91830128-2792-45f8-9cf2-62360166801f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:36.091706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91830128-2792-45f8-9cf2-62360166801f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:36.093163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91830128-2792-45f8-9cf2-62360166801f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:36.110907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 399/796] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:30:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:36.116647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.229624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6d48-0d62-4c5e-bc44-11c7591adc27 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.267138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:36.267779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.268053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.268572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.279972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:36.281578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-26c05235-21c9-4f2e-b9b6-931532a346f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:36.307528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:36.308953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:36.310232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:36.310232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:36.310232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:36.313723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 398/797] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:36.322950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830128-2792-45f8-9cf2-62360166801f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.435420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91830128-2792-45f8-9cf2-62360166801f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.460549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:36.462166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557121-c0a5-4234-8757-5058175e7752 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.462750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557121-c0a5-4234-8757-5058175e7752 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.463369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557121-c0a5-4234-8757-5058175e7752 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.469405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 399/798] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:36.471303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.471893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.472451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.474321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:36.475039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.475269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.475536 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.476182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:36.476480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:36.477871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:36.493690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:36.495640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 400/799] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:36.495930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:36.496538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.509104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:36.584485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 400/800] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:36.609590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21193e7-784f-42f0-a1f9-056dd50a4f99 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.646208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:36.647234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.647701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.648202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.655469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:36.657202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:36.669840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:36.670810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:36.671784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:36.673870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 401/801] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:36.682420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.790917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ade0-49c1-4d4e-a764-52cdf657169f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.828318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:36.829283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:36.829929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:36.830745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:36.832011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:36.832696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:36.834682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:36.844032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.849528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 401/802] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:36.856536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:36.867387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:36.914143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:36.985700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f851d70-045d-40ba-9558-e26ed9e25054 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:36.993315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9b95-7bbd-48b0-b580-11c0f05f8f63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:37.028390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:37.029279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.029561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.029869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/69b48bae4d894c849f19cbf3f4023171` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.033368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=965ff63b01c04728b214e71933f87792, role_id=69b48bae4d894c849f19cbf3f4023171)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:37.035287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:37.038041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:37.039063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.039472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.039740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.040710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:37.042491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:37.051814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:37.051814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:30:37.051814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [parameters: {'id': 'e807ac41f83b479286b054d24cbd127b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 06:30:37.051814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:37.060755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 06:30:37.061790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 06:30:37.066000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 06:30:37.066938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 06:30:37.067880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 06:30:37.069289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'id': 'e807ac41f83b479286b054d24cbd127b', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 06:30:37.070395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:37.071396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 06:30:37.072548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:37.073466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 402/803] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:36 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/965ff63b01c04728b214e71933f87792/roles/69b48bae4d894c849f19cbf3f4023171 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:30:37.073566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 402/804] 10.222.0.30 () {60 vars in 1137 bytes} [Tue Oct 11 06:30:36 2022] POST /identity/v3/domains => generated 190 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:37.073654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:37.161343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:37.202837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d41f-d6bb-473a-9531-469832673acf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:37.245271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:37.246182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.246623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.247036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.260025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:37.261328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ffdf9148-8f6a-4d7c-a20a-3b998bbda44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:37.278744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:37.279718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:37.280608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:37.280608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:37.280608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:37.282112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 403/805] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:37.288840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:37.396742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39805843-27d7-43d9-887d-4ac3fa59e95c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:37.404756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:37.435393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:37.436157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.436559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.436912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.437677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:37.438082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:37.439551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d59b4-0905-430c-9747-6ecece590519 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:37.461137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 403/806] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:37.587223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b477-27de-4fad-a996-9355cde59f21 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.587786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b477-27de-4fad-a996-9355cde59f21 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.587786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b477-27de-4fad-a996-9355cde59f21 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.589439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 404/807] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:37.595354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:37.595637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:37.595910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:37.621327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:37.622673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:37.699402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 404/808] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:37.962610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b477-27de-4fad-a996-9355cde59f21 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:38.074182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b477-27de-4fad-a996-9355cde59f21 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:38.093831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:38.111407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:38.112033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:38.112311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:38.112583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:38.113834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:38.115341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c1f7b-048e-4182-9469-bde8173c3357 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:38.117131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 405/809] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:38.122950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:38.224220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:38.231408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816a72-3ff1-4626-ac25-f6491ffc838d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:38.265981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:38.266596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:38.266867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:38.267131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:38.267789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:38.269309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796556f-3943-48e5-b0a6-30c8f7221a2d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:38.294371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 405/810] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:30:38 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:39.247156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bd49-056a-4f86-b030-162a59100000 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:39.247710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bd49-056a-4f86-b030-162a59100000 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:39.247834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8bd49-056a-4f86-b030-162a59100000 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:39.249175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 406/811] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:39.254910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:39.255379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:39.255468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:39.273788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:39.274961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:39.344774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 406/812] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:39.607921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8bd49-056a-4f86-b030-162a59100000 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:39.720391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8bd49-056a-4f86-b030-162a59100000 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:39.754661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:39.755293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:39.755567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:39.755822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:39.766222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:39.770940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:39.772005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:39.772830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 407/813] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 11 06:30:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:39.778389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:39.861115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:39.881034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8279f7-12bf-4b1e-b971-e5da66d8d33e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:39.915522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:39.916136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:39.916411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:39.916663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:39.917353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:39.917650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:39.919068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:39.927345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 407/814] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 11 06:30:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:39.933266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:39.983910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.037926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f50a-50df-496a-8eb1-8439963f4cbc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.072250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.072897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.073261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.073529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.084586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:40.086136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:40.101557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:40.102553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:40.103431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:40.103431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:40.103431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:40.103431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 408/815] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:40.108646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.218459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436028-d041-4b8d-8a46-b6245e2662c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.253177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.253808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.254072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.254341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.254987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:40.255524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:40.256702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:40.269531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 408/816] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:40.275066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.387000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.391501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da381687-cd4a-4330-bdd5-e3ce539df2b4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.425859 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.426497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.426774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.427046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.434921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:40.436366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5d05c817-c73d-4ccf-9dd4-7f71095f9777 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:30:40.447840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:40.449118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:40.450047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 409/817] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:40.454976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.459495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.469233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87fa5-84aa-42c7-998b-264c05b6555d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.469451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87fa5-84aa-42c7-998b-264c05b6555d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.469718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a87fa5-84aa-42c7-998b-264c05b6555d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.471192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 410/818] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:30:40.476238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.476514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.476781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.495217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:40.496389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:40.571814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 411/819] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:40.576121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e4c3-8d02-43c9-b8fe-5ff3f427a656 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.611726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.612348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.612614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.612877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.613648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:40.613949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:40.615499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:40.637451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 409/820] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:40.638652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.730310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.744257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e48a-03cc-4730-b2a1-da3ca69fcbdb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.778389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.778996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.779269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.779531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.839430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.847566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:40.849036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:40.904689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.943052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:40.946851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94aee-76af-4efc-af3b-a1904c4d467f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:40.957451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 412/821] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:30:40.963282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:40.983334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:40.983895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:40.984184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:40.984450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:40.998100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:41.002941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:41.004027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:41.004971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 410/822] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:41.011372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.071289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9582fc-2610-4063-943b-25463f20313e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.108513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.109360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.109635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.109903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.120831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.122456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.128682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c30088-a125-45fe-ba92-73bdf87fb3a7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:30:41.137211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:41.138358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:30:41.139413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:30:41.139413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:30:41.139413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:41.139413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 413/823] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:41.144745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.154339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.165895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.166515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.166791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.167063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.167776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:41.168075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.169506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.181168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 411/824] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:41.185544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.191052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.258833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3ae7-e1a7-4367-9c82-6da07e2835ee None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.295881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c534-a86f-4f11-a0dd-28e3628ac3b5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.299070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.299692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.299979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.300251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.300895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:41.301234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.302684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.316959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 414/825] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:41.322817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.336684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.337361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.337630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.337895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] PATH_INFO: `/v3/users/25b45a08ca7147aa808a30eddcb477df` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.352169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] RBAC: Authorizing `identity:get_user(user_id=25b45a08ca7147aa808a30eddcb477df)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.353802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.355683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 412/826] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/users/25b45a08ca7147aa808a30eddcb477df => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:41.362008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.405165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.428228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.431307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bab9a-88ed-4c5b-9f20-86731c571096 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.467519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.468007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7b174-8836-4e32-93f2-880fa130fa8d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.468185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.468411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.468676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.475695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.477187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:30:41.489821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:41.490827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:30:41.491711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 415/827] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:30:41.497199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.508074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.508810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.509226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.509789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.511230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] RBAC: Authorizing `identity:get_project(project_id=b1595d495f9145d896a4f1d1490a53f7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.513372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.514781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 413/828] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:41.520360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.606912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f57f4-819f-4866-8619-def9b36b6acc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.636628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579945f1-f3ed-41e3-8f93-2de366d80261 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.642703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.643317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.643586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.644205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.644531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:41.644823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.646330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.647547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.659493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 416/829] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:41.665731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:41.673253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.673919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.674190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.674462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7/users/25b45a08ca7147aa808a30eddcb477df/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.676749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1595d495f9145d896a4f1d1490a53f7, user_id=25b45a08ca7147aa808a30eddcb477df, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.678250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cad41-9673-442e-bfd6-dca9332a3d34 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.689724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:41.692894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 414/830] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:41 2022] PUT /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7/users/25b45a08ca7147aa808a30eddcb477df/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:30:41.783822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82273-d13b-4f00-b142-36eb2e75d1a3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:41.822560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:41.823202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:41.823483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:41.823715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:41.824462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] RBAC: Adding query filter params (role.id=69b48bae4d894c849f19cbf3f4023171, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=965ff63b01c04728b214e71933f87792) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:41.824765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:41.826418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24584e-236c-4ef5-a6a4-47a64a6f9555 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:41.834197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 417/831] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:41 2022] GET /identity/v3/role_assignments?user.id=965ff63b01c04728b214e71933f87792&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=69b48bae4d894c849f19cbf3f4023171 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:30:43.859660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0d7b-0698-4046-b269-0f988c0a0613 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:43.860167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0d7b-0698-4046-b269-0f988c0a0613 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:43.860167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f0d7b-0698-4046-b269-0f988c0a0613 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:43.861455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 415/832] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:43.866760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:43.867159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:43.869979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:43.885776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:43.886977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:43.951377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 418/833] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:44.217261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f0d7b-0698-4046-b269-0f988c0a0613 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:44.321500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f0d7b-0698-4046-b269-0f988c0a0613 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:44.354637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:44.355257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:44.355529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:44.355792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:44.366078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:30:44.370959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:30:44.372110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:30:44.373342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 416/834] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:30:44.378260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:44.393237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:44.478489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07f60-dd6a-4ee0-a3ff-dc939f8806a1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:44.515380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:44.515973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:44.516245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:44.516507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:44.517192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:44.517483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:44.518845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:44.527012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 419/835] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:44.533717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:44.567469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:44.651006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2529-d662-4521-a649-d486fb1163d1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:44.685863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:44.686480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:44.686749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:44.687017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] PATH_INFO: `/v3/users/25b45a08ca7147aa808a30eddcb477df` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:44.688279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] RBAC: Authorizing `identity:get_user(user_id=25b45a08ca7147aa808a30eddcb477df)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:44.689751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:44.691314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 417/836] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:44 2022] GET /identity/v3/users/25b45a08ca7147aa808a30eddcb477df => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:44.697439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:44.779664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:44.803576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d47b2-d72c-4797-aca8-b93961b0b706 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:44.838192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:44.838787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:44.839059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:44.839324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:44.908913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:44.910368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:44.988164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:45.012801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 420/837] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:30:45.018899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:45.127509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:45.132115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2944-bc8b-46f5-87e6-4460e3880b6d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:45.168717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:45.169369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:45.169644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:45.169914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:45.171089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=b1595d495f9145d896a4f1d1490a53f7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:45.172524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b2160-366a-4254-a402-ddf21ded3ca7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:45.174182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 418/838] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:30:45 2022] GET /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:45.181440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:45.304252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c6d4-9e24-4c88-81d1-0612d7dc99d2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:45.339703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:45.340296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:45.340567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:45.340827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:45.341556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=b1595d495f9145d896a4f1d1490a53f7, user.id=25b45a08ca7147aa808a30eddcb477df) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:45.341862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:45.343265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a988c8-e594-4db4-a205-6461be768259 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:45.348863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 421/839] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:45 2022] GET /identity/v3/role_assignments?user.id=25b45a08ca7147aa808a30eddcb477df&scope.project.id=b1595d495f9145d896a4f1d1490a53f7&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:47.467694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44d00-af06-4b95-818c-d1ee1c5df83f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:47.468302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44d00-af06-4b95-818c-d1ee1c5df83f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:47.468302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44d00-af06-4b95-818c-d1ee1c5df83f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:47.469613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 419/840] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:47.475957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:47.476640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:47.476758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:47.500829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:47.502039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:47.537613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:47.571145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 422/841] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:47.833517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44d00-af06-4b95-818c-d1ee1c5df83f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:47.945078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44d00-af06-4b95-818c-d1ee1c5df83f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:47.980156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:47.980771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:47.981042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:47.981338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:47.982561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:47.983985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4465c7-94bc-4f83-9540-f8013c3916c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:47.985554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 420/842] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:47.993222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:48.096431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8829d1-bfd5-48e9-9718-2384c0b221a2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:48.135972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:48.136573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:48.136847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:48.137141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:48.137790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:48.139216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ba35b-7529-49e9-832a-29436b1ab51f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:48.167835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 423/843] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:30:47 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:50.313161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990eebf-286b-4340-8d18-1884bbf0f155 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:50.313767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990eebf-286b-4340-8d18-1884bbf0f155 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:50.313767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990eebf-286b-4340-8d18-1884bbf0f155 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:50.315032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 421/844] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:50.321411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:50.322134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:50.322323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:50.347190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:50.348373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:50.370934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:50.420783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 424/845] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:50.686574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990eebf-286b-4340-8d18-1884bbf0f155 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:50.728278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:50.796387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990eebf-286b-4340-8d18-1884bbf0f155 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:50.830586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:50.831492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:50.831765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:50.832034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] PATH_INFO: `/v3/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:50.833508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] RBAC: Authorizing `identity:get_role(role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:50.834897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:50.836179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 422/846] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:50 2022] GET /identity/v3/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:50.842183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:50.940153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ca1f-5c7a-4488-a2f0-10edb429818f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:50.975049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:50.975663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:50.975947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:50.976212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] PATH_INFO: `/v3/users/5c955dc7fa2347e4a917fa25629c62f8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:50.992869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] RBAC: Authorizing `identity:get_user(user_id=5c955dc7fa2347e4a917fa25629c62f8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:50.995159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:50.997650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 425/847] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:50 2022] GET /identity/v3/users/5c955dc7fa2347e4a917fa25629c62f8 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:51.006810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:51.113125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf053614-f4c1-409a-acac-20238f1efc6f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:51.114656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:51.148759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:51.149406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:51.149673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:51.149938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:51.151092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] RBAC: Authorizing `identity:get_project(project_id=b1595d495f9145d896a4f1d1490a53f7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:51.152517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9308-1d55-41da-96be-1973635c1d10 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:51.154154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 423/848] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:30:51 2022] GET /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:51.160375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:51.178327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:51.270816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a444-c94b-44d1-b4f1-9fb30fc09b04 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:51.305480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:51.306122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:51.306367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:51.306637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7/users/5c955dc7fa2347e4a917fa25629c62f8/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:51.309193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1595d495f9145d896a4f1d1490a53f7, user_id=5c955dc7fa2347e4a917fa25629c62f8, role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:51.310643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb51ea-b9f3-40ab-9723-8ee6437ba575 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:51.328949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 426/849] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:30:51 2022] PUT /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7/users/5c955dc7fa2347e4a917fa25629c62f8/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:30:53.428042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639e3a-fce0-46bb-83a4-d72de866a319 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:53.428938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639e3a-fce0-46bb-83a4-d72de866a319 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:53.428938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639e3a-fce0-46bb-83a4-d72de866a319 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:53.431061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 424/850] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:53.437422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:53.438196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:53.438326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:53.464878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:53.466110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:53.537345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 427/851] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:30:53.806568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639e3a-fce0-46bb-83a4-d72de866a319 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:53.923218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639e3a-fce0-46bb-83a4-d72de866a319 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:53.957545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:53.958157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:53.958424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:53.958735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] PATH_INFO: `/v3/roles/2fe08520986d4aa7bb1cb6e78c716101` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:53.960157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] RBAC: Authorizing `identity:get_role(role_id=2fe08520986d4aa7bb1cb6e78c716101)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:53.961538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:53.962816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 425/852] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:53 2022] GET /identity/v3/roles/2fe08520986d4aa7bb1cb6e78c716101 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:53.968689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:53.971903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:54.070687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a62708-2a2f-4a6e-9c5c-336e53472724 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:54.105306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:54.105922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:54.106189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:54.106448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] PATH_INFO: `/v3/users/5c955dc7fa2347e4a917fa25629c62f8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:54.107680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] RBAC: Authorizing `identity:get_user(user_id=5c955dc7fa2347e4a917fa25629c62f8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:54.109129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:54.110687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 428/853] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:30:53 2022] GET /identity/v3/users/5c955dc7fa2347e4a917fa25629c62f8 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:54.116828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:54.163102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:54.234900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5baec-38c1-4210-aa9f-5fff792fa0ac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:54.269576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:54.270164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:54.270429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:54.270692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:54.340030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:54.341442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:54.381454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:54.447141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 426/854] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:30:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:30:54.453340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:54.529865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:54.562383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f434-aea7-4640-adee-3238c65df111 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:54.598430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:54.598987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:54.599297 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:54.599567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] PATH_INFO: `/v3/projects/b1595d495f9145d896a4f1d1490a53f7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:54.600749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] RBAC: Authorizing `identity:get_project(project_id=b1595d495f9145d896a4f1d1490a53f7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:54.602218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd29b0-2d7e-41fe-9700-5a97aa769b1f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:54.603842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 429/855] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:30:54 2022] GET /identity/v3/projects/b1595d495f9145d896a4f1d1490a53f7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:54.613515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:54.723546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f9bf4-60f8-4097-8078-f294c27836c4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:54.759473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:54.760063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:54.760327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:54.760598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:54.761335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] RBAC: Adding query filter params (role.id=2fe08520986d4aa7bb1cb6e78c716101, scope.project.id=b1595d495f9145d896a4f1d1490a53f7, user.id=5c955dc7fa2347e4a917fa25629c62f8) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:30:54.761630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:54.763042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce595b9-9d3b-422c-aed0-1e2e7717cdde None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:54.768787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 427/856] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:30:54 2022] GET /identity/v3/role_assignments?user.id=5c955dc7fa2347e4a917fa25629c62f8&scope.project.id=b1595d495f9145d896a4f1d1490a53f7&role.id=2fe08520986d4aa7bb1cb6e78c716101 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:56.895657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4130c4-59df-44d1-b0af-888c521c057f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:56.896541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4130c4-59df-44d1-b0af-888c521c057f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:56.896541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4130c4-59df-44d1-b0af-888c521c057f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:56.898658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 430/857] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:56.906790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:56.907227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:56.907314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:56.914180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:56.927340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:56.928525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:57.005489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 428/858] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 06:30:57.274191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4130c4-59df-44d1-b0af-888c521c057f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:57.383700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4130c4-59df-44d1-b0af-888c521c057f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:57.421423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:57.422042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:57.422315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:57.422581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:57.423806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:57.425276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2416006-8f89-4cdf-8c77-93ab13acee65 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:57.426884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 431/859] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:30:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:30:57.433045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:30:57.540350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca5cef-e60b-4ca3-89f4-bc1f289ea225 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:30:57.570126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:30:57.575763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:30:57.576377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:57.576652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:57.576921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:57.577614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:30:57.579045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6fa12-2905-4d65-bbb6-8225d5e5fd1b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:30:57.607099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 429/860] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:30:57 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:30:59.756687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0366-bb02-4ad9-81e2-c20a9c49b3c0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:59.757722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0366-bb02-4ad9-81e2-c20a9c49b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:59.757722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0366-bb02-4ad9-81e2-c20a9c49b3c0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:59.759694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 432/861] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:30:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:30:59.766479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:30:59.766919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:30:59.767025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:30:59.793253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:30:59.794434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:30:59.865706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 430/862] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:30:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:00.129700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0366-bb02-4ad9-81e2-c20a9c49b3c0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:00.146910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:00.252535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0366-bb02-4ad9-81e2-c20a9c49b3c0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:00.287647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:00.288257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:00.288525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:00.288787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:00.290048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:00.291472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2645566-b07f-4ddd-aa5f-84cb4c4bb027 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:00.293016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 433/863] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:31:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:00.299927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:00.528215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8a466-9375-4786-aec8-6304ba303066 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:00.545798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:00.572846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:00.573506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:00.573777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:00.574029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:00.574676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:00.576123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d0d32-c4d0-4850-bcc2-983083599744 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:00.598785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 431/864] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:31:00 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:31:02.745971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a9-3258-4db6-ab98-a424301fe9cf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:02.746813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a9-3258-4db6-ab98-a424301fe9cf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:02.746813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a9-3258-4db6-ab98-a424301fe9cf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:02.749051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 434/865] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:02.755426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:02.755887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:02.755978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:02.774720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:02.775907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:02.852452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 432/866] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:03.117892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90598a9-3258-4db6-ab98-a424301fe9cf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:03.209204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:03.234525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90598a9-3258-4db6-ab98-a424301fe9cf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:03.268508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:03.269195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:03.269467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:03.269735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:03.280753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:31:03.285556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:31:03.286627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:31:03.287476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 435/867] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:31:03.293167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:03.395598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:03.398779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472b763-b188-4811-9e80-4ea0cdbe3181 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:03.433346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:03.433948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:03.434222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:03.434486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:03.435132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:03.435426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:03.436785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:03.447111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 433/868] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:31:03.453408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:03.560725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dcb6f-1d8c-46f1-9135-41de83ceae34 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:03.596181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:03.596825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:03.597102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:03.597363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] PATH_INFO: `/v3/users/b9edcc94780348a4be36be644a663bd2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:03.600134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:03.617901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] RBAC: Authorizing `identity:get_user(user_id=b9edcc94780348a4be36be644a663bd2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:03.620232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:03.622813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 436/869] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:31:03 2022] GET /identity/v3/users/b9edcc94780348a4be36be644a663bd2 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:03.629615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:03.738464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7730c-1a92-459b-a2a9-117e67213337 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:03.773995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:03.774574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:03.774865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:03.775128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] PATH_INFO: `/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:03.776272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec145c415a14e7d9dbcb211c38ac73e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:03.777724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735b437-aa72-4e43-b8f1-5ff33ea63ee1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:03.779266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 434/870] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:31:03 2022] GET /identity/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:03.785715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:03.894016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c8cc3-ae47-414b-98b1-39e4ce4a0357 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:03.936444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:03.937111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:03.937381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:03.937644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] PATH_INFO: `/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e/users/b9edcc94780348a4be36be644a663bd2/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:03.939970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ec145c415a14e7d9dbcb211c38ac73e, user_id=b9edcc94780348a4be36be644a663bd2, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:03.941425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4dce3-3786-4689-9d4a-7b07dc133861 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:03.957237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 437/871] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:31:03 2022] PUT /identity/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e/users/b9edcc94780348a4be36be644a663bd2/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:31:06.063939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418881-d0ee-42d9-aa0a-708453907137 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:06.064504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418881-d0ee-42d9-aa0a-708453907137 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:06.064504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418881-d0ee-42d9-aa0a-708453907137 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:06.065890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 435/872] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:06.072253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:06.072966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:06.073128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:06.095961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:06.097269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:06.159180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:06.179253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 438/873] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:06.450337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418881-d0ee-42d9-aa0a-708453907137 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:06.493451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:06.574069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418881-d0ee-42d9-aa0a-708453907137 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:06.613784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:06.614411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:06.614680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:06.614945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:06.626799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:31:06.631831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:31:06.632954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:31:06.634033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 436/874] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:31:06.639697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:06.746184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52f1e3-f08c-437e-9cf1-57302cec573c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:06.783338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:06.783939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:06.784207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:06.784470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:06.785153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:06.785444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:06.786915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:06.795387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 439/875] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:06.805652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:06.905394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:06.916328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7853e3-052c-49c4-b662-81f1e265f87e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:06.962203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:06.962839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:06.963110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:06.963373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] PATH_INFO: `/v3/users/b9edcc94780348a4be36be644a663bd2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:06.964718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] RBAC: Authorizing `identity:get_user(user_id=b9edcc94780348a4be36be644a663bd2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:06.966197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:06.967746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 437/876] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:31:06 2022] GET /identity/v3/users/b9edcc94780348a4be36be644a663bd2 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:06.975401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:07.036620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:07.091289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39063fb0-4bb0-4745-8bf8-1d382814e04e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:07.131287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:07.131888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:07.132155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:07.132420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:07.199990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:07.201455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:07.248361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:07.305226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 440/877] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:31:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:31:07.311547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:07.414891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79618c9c-d18b-41ae-b98f-4fc0d59296ff None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:07.451261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:07.451877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:07.452146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:07.452413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] PATH_INFO: `/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:07.453654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] RBAC: Authorizing `identity:get_project(project_id=8ec145c415a14e7d9dbcb211c38ac73e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:07.455097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ec5ac-f2b3-44e3-b12d-aeb8e17ce952 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:07.457100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 438/878] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:31:07 2022] GET /identity/v3/projects/8ec145c415a14e7d9dbcb211c38ac73e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:07.464333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:07.571992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d2bc9-c7cd-4861-a3bb-d7c1d3ae8641 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:07.614304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:07.614901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:07.616846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:07.617159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:07.617892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=8ec145c415a14e7d9dbcb211c38ac73e, user.id=b9edcc94780348a4be36be644a663bd2) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:07.618193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:07.619634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d94f1-0c4d-4e02-8cfa-a4ee923503b3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:07.626013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 441/879] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:31:07 2022] GET /identity/v3/role_assignments?user.id=b9edcc94780348a4be36be644a663bd2&scope.project.id=8ec145c415a14e7d9dbcb211c38ac73e&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:31:09.728470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76554f-1603-43ce-90f4-11a93d7610c8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:09.729167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76554f-1603-43ce-90f4-11a93d7610c8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:09.729167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76554f-1603-43ce-90f4-11a93d7610c8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:09.730363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 439/880] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:09.736711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0878f-e1cc-44cc-a308-12ce52eeba95 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:09.737499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0878f-e1cc-44cc-a308-12ce52eeba95 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:09.737675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0878f-e1cc-44cc-a308-12ce52eeba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:09.759258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-20b0878f-e1cc-44cc-a308-12ce52eeba95 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:09.760448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-20b0878f-e1cc-44cc-a308-12ce52eeba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:09.763276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:09.832849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 442/881] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:10.106676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76554f-1603-43ce-90f4-11a93d7610c8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:10.135276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:10.206619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76554f-1603-43ce-90f4-11a93d7610c8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:10.240621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:10.241228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:10.241498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:10.241761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:10.242419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:10.243770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8a546-b627-40ec-a9b6-82b92afe2952 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:10.261170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 440/882] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Oct 11 06:31:10 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:31:12.402594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c7c0-9140-426e-b804-d1cedacf923f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:12.403196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c7c0-9140-426e-b804-d1cedacf923f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:12.403196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96c7c0-9140-426e-b804-d1cedacf923f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:12.404497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 443/883] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:12.410899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:12.411622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:12.411797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:12.432195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:12.433409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:12.506394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 441/884] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:12.783013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96c7c0-9140-426e-b804-d1cedacf923f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:12.892675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96c7c0-9140-426e-b804-d1cedacf923f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:12.927500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:12.928116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:12.928386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:12.928651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] PATH_INFO: `/v3/domains/c10a628a153c4d069bb2a8f4c4c66e2c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:12.936865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:12.941284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c10a628a153c4d069bb2a8f4c4c66e2c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:12.944273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4c07-9a35-43e8-b546-cf1abc0b4b49 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:12.947127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 444/885] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Oct 11 06:31:12 2022] GET /identity/v3/domains/c10a628a153c4d069bb2a8f4c4c66e2c => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:12.956892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:12.975949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:13.061880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f133a0e-97f0-4381-a633-ba3fc4781a3b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:13.096767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:13.097390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:13.097655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:13.097920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:13.098559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:13.100061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004067-6822-44fd-baf4-b46ad907574c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:13.134616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 442/886] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:31:12 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:31:15.296107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fc9f-0e95-406a-913f-8b2bac930c9c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:15.296704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fc9f-0e95-406a-913f-8b2bac930c9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:15.296704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fc9f-0e95-406a-913f-8b2bac930c9c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:15.298029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 445/887] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:15.304804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:15.305623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:15.305720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:15.329319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:15.330852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:15.399766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:15.410717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 443/888] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:15.673924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851fc9f-0e95-406a-913f-8b2bac930c9c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:15.798560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851fc9f-0e95-406a-913f-8b2bac930c9c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:15.835824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:15.836386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:15.836657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:15.836928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] PATH_INFO: `/v3/domains/c10a628a153c4d069bb2a8f4c4c66e2c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:15.838112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=c10a628a153c4d069bb2a8f4c4c66e2c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:15.839543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d4c34-52fe-4ac2-a178-b3682341d87f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:15.841084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 446/889] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Oct 11 06:31:15 2022] GET /identity/v3/domains/c10a628a153c4d069bb2a8f4c4c66e2c => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:15.846993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:15.947375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447814c-bc4e-407c-ba6b-0d36a6b5d5a7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:15.984520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:15.985146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:15.985416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:15.985679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:15.986325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:15.987734 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7ffd-3383-4435-9a8b-31f676dafee9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:16.010978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 444/890] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:31:15 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:31:18.147188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e756-ed9c-4ab4-ad73-401b12c321cc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:18.147782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e756-ed9c-4ab4-ad73-401b12c321cc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:18.147782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e756-ed9c-4ab4-ad73-401b12c321cc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:18.149068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 447/891] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:18.155774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:18.156480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:18.156637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:18.183611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:18.184813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:18.237362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:18.263368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 445/892] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:18.524638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e756-ed9c-4ab4-ad73-401b12c321cc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:18.604117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:18.642842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e756-ed9c-4ab4-ad73-401b12c321cc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:18.677710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:18.678333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:18.678610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:18.678872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:18.689684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:31:18.694453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:31:18.695580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:31:18.696831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 448/893] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:31:18.704000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:18.804524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2769638-86f4-43e3-bfb0-8651f05c0292 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:18.839323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:18.839908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:18.840178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:18.840438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:18.841111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:18.841411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:18.842759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:18.850699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 446/894] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:18.859659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:18.961709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4fa0b-1a27-4744-aa0e-1ce3db74dacb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:18.990085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:18.998987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:18.999594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:18.999861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:19.000121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] PATH_INFO: `/v3/users/7aefdafb23d0431ea90e0fad327413c6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:19.013267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] RBAC: Authorizing `identity:get_user(user_id=7aefdafb23d0431ea90e0fad327413c6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:19.014689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:19.016251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 449/895] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:31:18 2022] GET /identity/v3/users/7aefdafb23d0431ea90e0fad327413c6 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:19.022182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:19.069448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:19.122737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87be76-22ba-48ad-a7af-2c05e4413ba0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:19.165311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:19.165933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:19.166196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:19.166470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] PATH_INFO: `/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:19.167637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] RBAC: Authorizing `identity:get_project(project_id=a9ec77ff564e45e6b61776907c1a0ee4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:19.169066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de96939-3c92-4173-aff3-e059a8debf1f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:19.170705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 447/896] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:31:19 2022] GET /identity/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:19.176830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:19.282059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e0b8-b691-4a08-b160-3daae17cb31e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:19.319678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:19.320248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:19.320518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:19.320785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] PATH_INFO: `/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4/users/7aefdafb23d0431ea90e0fad327413c6/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:19.322965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] RBAC: Authorizing `identity:create_grant(project_id=a9ec77ff564e45e6b61776907c1a0ee4, user_id=7aefdafb23d0431ea90e0fad327413c6, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:19.324384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4e2f-c857-4c05-928a-15533024599c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:19.347081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 450/897] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:31:19 2022] PUT /identity/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4/users/7aefdafb23d0431ea90e0fad327413c6/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:31:21.441237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16868-a876-4789-9c98-7a3321b72ad8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:21.442142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16868-a876-4789-9c98-7a3321b72ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:21.442142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d16868-a876-4789-9c98-7a3321b72ad8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:21.444230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 448/898] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:31:21.450554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:21.451249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:21.451400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:21.479914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:31:21.481154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:31:21.525241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:21.553691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 451/899] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:31:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:31:21.815901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16868-a876-4789-9c98-7a3321b72ad8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:21.927866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d16868-a876-4789-9c98-7a3321b72ad8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:21.941230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:21.969529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:21.970152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:21.970422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:21.970680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:21.981031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:31:21.985768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:31:21.986837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:31:21.987923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 449/900] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:31:21.993092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:22.091541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4a12e-630c-4da2-9157-d4059b671a1f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:22.128050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:22.128632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:22.128907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:22.129202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:22.129853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:22.130147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:22.131504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:22.139778 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 452/901] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:22.145848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:22.251493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec9f0-5b7e-4d03-a67e-0f3e28860dcf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:22.286050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:22.286652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:22.286920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:22.287179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] PATH_INFO: `/v3/users/7aefdafb23d0431ea90e0fad327413c6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:22.288468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] RBAC: Authorizing `identity:get_user(user_id=7aefdafb23d0431ea90e0fad327413c6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:22.289902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:22.291448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 450/902] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 11 06:31:22 2022] GET /identity/v3/users/7aefdafb23d0431ea90e0fad327413c6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:22.299776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:22.342416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:22.407674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd746a1-9746-41e6-8bf3-4a6d89106e2c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:22.443995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:22.444606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:22.444878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:22.445174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:22.515102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:22.516547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:22.554522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:22.619338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 453/903] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:31:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:31:22.629066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:22.673907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:22.731842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39223-fe34-4adc-abab-5a9c7b329034 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:22.765997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:22.766608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:22.766877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:22.767140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] PATH_INFO: `/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:22.768357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a9ec77ff564e45e6b61776907c1a0ee4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:22.769799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20a23e-e77b-4923-9c7a-4d5f5681d3d4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:22.771384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 451/904] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 11 06:31:22 2022] GET /identity/v3/projects/a9ec77ff564e45e6b61776907c1a0ee4 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:22.780565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:31:22.882409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24cb-de56-400e-921a-904abeac5066 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:31:22.916359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:31:22.916952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:31:22.917247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:31:22.917510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:31:22.918214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=a9ec77ff564e45e6b61776907c1a0ee4, user.id=7aefdafb23d0431ea90e0fad327413c6) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:31:22.918519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:31:22.919930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4308c6-93d8-43f2-96f3-c6c599b89111 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:31:22.925682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 454/905] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:31:22 2022] GET /identity/v3/role_assignments?user.id=7aefdafb23d0431ea90e0fad327413c6&scope.project.id=a9ec77ff564e45e6b61776907c1a0ee4&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:31:32.761518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=45 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:31:32.923108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:18.618793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400a87-e330-4089-9aef-9b992f020a55 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:18.619503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400a87-e330-4089-9aef-9b992f020a55 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:18.619503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400a87-e330-4089-9aef-9b992f020a55 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:18.620767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 452/906] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:32:18.626761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:18.627333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:18.627333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:18.649088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:18.651311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:18.740062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 455/907] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:19.012010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4400a87-e330-4089-9aef-9b992f020a55 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:19.134377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4400a87-e330-4089-9aef-9b992f020a55 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:19.172069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:19.172833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:19.173221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:19.173600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:19.185402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:19.186924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:19.203585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:19.205111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:19.210406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:19.210406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:19.210406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:19.210406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 453/908] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:19.212184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:19.330791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6042574-b5cb-4424-8e3f-5bfd502b9465 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:19.369031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:19.377095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:19.377724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:19.378005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:19.378297 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:19.378953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:19.379273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:19.380759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116fe6d-60df-4700-9224-b53dcd005266 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:19.393306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 456/909] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:19.399322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:19.462963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:19.520694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858110ff-eb9c-4125-b4d5-e8d5d3ec09df None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:19.560099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:19.561074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:19.561528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:19.561964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:19.562778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:19.564354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b61a5e-7901-4307-9353-9376e3a2a547 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:19.589159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 454/910] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 11 06:32:19 2022] POST /identity/v3/users => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:32:22.012129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398b5d-fadc-47ab-9019-e23875d4c914 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:22.012718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398b5d-fadc-47ab-9019-e23875d4c914 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:22.012718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398b5d-fadc-47ab-9019-e23875d4c914 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:22.014317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 457/911] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:22.020037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:22.020508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:22.020628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:22.039703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:22.041051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:22.117417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 455/912] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:22.408381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398b5d-fadc-47ab-9019-e23875d4c914 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:22.537633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398b5d-fadc-47ab-9019-e23875d4c914 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:22.583419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39452902-933c-471b-a8ee-668041107035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:22.584055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39452902-933c-471b-a8ee-668041107035 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:22.584328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39452902-933c-471b-a8ee-668041107035 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:22.584590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39452902-933c-471b-a8ee-668041107035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:22.595717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39452902-933c-471b-a8ee-668041107035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-39452902-933c-471b-a8ee-668041107035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:32:22.600482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:22.601515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:22.602393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 458/913] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:22.609880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:22.663016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:22.736967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9a2d-6623-45c6-a781-7c1352e95202 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:22.779554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:22.780180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:22.780451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:22.780710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:22.781411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:22.781703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:22.783257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:22.800608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 456/914] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:22.801996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39452902-933c-471b-a8ee-668041107035 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:22.866256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:22.927838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39452902-933c-471b-a8ee-668041107035 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:22.971512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:22.972249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:22.972567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:22.972827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:22.984561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:22.986223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:23.001623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:23.002664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:23.003599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:23.003599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:23.003599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:23.007856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 459/915] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:23.009495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.130944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:23.135553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e6f0-8d7f-4885-8876-e9824713a270 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:23.172147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:23.172796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:23.173070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:23.173377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:23.174047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:23.174361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:23.175831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.189158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 457/916] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:23.195980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.327131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a85bb-48f8-4b26-9ca9-4e50f3fbf821 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:23.328788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:23.373105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:23.373728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:23.375092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:23.375366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:23.385946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:23.387450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:32:23.400130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:23.401492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:23.402827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 460/917] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:23.407737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.520912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7fbf-efb9-4d83-b90d-795a96391ab7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:23.565706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:23.566341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:23.566616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:23.566908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:23.567616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:23.567911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:23.569449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.587867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 458/918] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:23.593899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.710323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a564-c31a-46cf-9066-1d017b8010a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:23.748812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:23.749484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:23.749798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:23.750085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:23.760661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:23.762127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:23.778110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:23.779258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:23.780180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:23.780180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:23.780180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:23.780180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 461/919] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:23.785048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.806515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:23.894077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccfc95-7c5d-42d8-bf08-65d151f17ac1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:23.929141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:23.929831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:23.930133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:23.930391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:23.930999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:23.931296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:23.932643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:23.944420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 459/920] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:23.950212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:23.967641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:24.060963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3895-bfa7-4d92-805a-eac8c3e79177 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:24.099500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:24.100209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:24.100506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:24.100777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:24.108790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:24.110414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:32:24.121915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:24.122891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:24.123812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 462/921] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:32:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:24.129345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:24.223217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:24.249721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a6c1-f2f9-4793-ad0b-b06227345e3f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:24.285866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:24.286527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:24.286801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:24.287071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:24.287766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:24.288130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:24.289623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef0df-208f-40ea-858d-f71ca87869ad None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:24.302319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 460/922] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:24.308563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:24.395636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:24.427075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f8a6-4412-4c17-81fc-ae6a811b620a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:24.468462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:24.469190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:24.469465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:24.469737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d2b49f6dc22e4831951be6d7192226c9/roles/b04de177d1944ce88b4ab2e4ea2af098` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:24.485254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=d2b49f6dc22e4831951be6d7192226c9, role_id=b04de177d1944ce88b4ab2e4ea2af098)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:24.486833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25e877-2689-4a6e-98c8-e74e460279d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:24.503393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 463/923] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:32:24 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d2b49f6dc22e4831951be6d7192226c9/roles/b04de177d1944ce88b4ab2e4ea2af098 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:32:27.086938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140109b-fa46-4b2a-91ad-4deb37eaa325 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:27.087510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140109b-fa46-4b2a-91ad-4deb37eaa325 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:27.087510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140109b-fa46-4b2a-91ad-4deb37eaa325 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:27.088817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 461/924] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:27.094291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:27.094758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:27.094862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:27.114543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:27.115748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:27.189131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 464/925] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:27.465760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140109b-fa46-4b2a-91ad-4deb37eaa325 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:27.586228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140109b-fa46-4b2a-91ad-4deb37eaa325 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:27.622001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:27.622636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:27.622910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:27.623171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:27.630647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:27.636790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:32:27.641681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:27.642622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:27.643496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 462/926] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 11 06:32:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:27.649854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:27.708406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:27.757422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325577b9-8cbd-4a48-95f9-2fc868c53a6c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:27.791245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:27.791855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:27.792130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:27.792395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:27.793092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:27.793382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:27.794783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:27.802639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 465/927] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 11 06:32:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:27.809402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:27.920187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f4c-55b6-4939-93f1-b7a1c5aa4be4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:27.956500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:27.957175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:27.957443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:27.957713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:27.968988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:27.970546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:27.986125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:27.987168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:27.988077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:27.988077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:27.988077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:27.988077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 463/928] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:27.993767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:28.100156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500e9f1-82f9-4ec0-bef7-da8ce9341aa8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:28.117144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:28.137017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:28.137630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:28.137899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:28.138161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:28.138795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:28.139089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:28.140452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:28.153282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 466/929] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:28.159386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:28.215405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:28.275380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801a06-29da-47f6-8fec-0934fc03fe74 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:28.309663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:28.310296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:28.310573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:28.310841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:28.318298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:28.319740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:32:28.331413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:28.332565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:28.333702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 464/930] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:28.338903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:28.445533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3468-2d50-43a7-b071-9ccf2f533775 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:28.482757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:28.485308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:28.485603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:28.485896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:28.486741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:28.487079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:28.488830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:28.508127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 467/931] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 11 06:32:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:28.514514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:28.627252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3cbc-91c1-4f27-8898-c1f8b9cf3006 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:28.638376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:28.663378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:28.663997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:28.664276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:28.664545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:28.735582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:28.736954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:28.843477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 465/932] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:32:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:32:28.849590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:28.885334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:28.954382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111196-0ee7-4ebf-a729-e52d0400686a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:28.991659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:28.992265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:28.992599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:28.992968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:29.003690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:29.005394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:29.021313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:29.022568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:29.023533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:29.023533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:29.023533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:29.023533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 468/933] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:29.028466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:29.040102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:29.129922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eca103-bfb1-4847-9415-64b62b249a4d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:29.164605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:29.165425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:29.165525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:29.165761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:29.166408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:29.166723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:29.168118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:29.181471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 466/934] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:29.186704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:29.285310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:29.302199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dedf3-8103-49d6-b475-2a3048e537c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:29.336930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:29.337587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:29.337857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:29.338120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:29.345583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:29.347242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:32:29.359406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:29.360516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:29.361630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 469/935] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:32:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:29.368910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:29.443361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:29.477771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189bb45-0f37-47fd-afd9-d4b77639a99e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:29.512692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:29.513482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:29.513755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:29.514017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:29.514869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:29.515173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:29.516806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1da360-d15d-41eb-ab27-0ebeb4fcab66 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:29.529217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 467/936] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:32:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:29.536094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:29.649841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67fa4-2bde-49b5-8d32-29ab8c998cd4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:29.685843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:29.686458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:29.686732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:29.686996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:29.687722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] RBAC: Adding query filter params (role.id=b04de177d1944ce88b4ab2e4ea2af098, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=d2b49f6dc22e4831951be6d7192226c9) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:29.688071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:29.689929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6b3a0-1a55-4591-9a30-cd3a001686cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:29.696605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 470/937] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:32:29 2022] GET /identity/v3/role_assignments?user.id=d2b49f6dc22e4831951be6d7192226c9&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04de177d1944ce88b4ab2e4ea2af098 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:31.944493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a882-10b9-488e-a01f-620fe0c165a4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:31.945080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a882-10b9-488e-a01f-620fe0c165a4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:31.945204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a882-10b9-488e-a01f-620fe0c165a4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:31.946544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 468/938] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:31.952281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:31.952741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:31.952836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:31.974227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:31.975597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:31.979415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:32.054616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 471/939] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:32.340526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a882-10b9-488e-a01f-620fe0c165a4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:32.448068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a882-10b9-488e-a01f-620fe0c165a4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:32.479511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:32.486470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:32.487106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:32.487409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:32.487676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:32.498799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:32:32.503962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:32.509163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:32.510325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 469/940] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:32:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:32.512106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:32.617519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca4032-f060-4489-ac0b-50c63deccb85 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:32.651193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:32.651833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:32.652075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:32.652342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:32.653062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:32.653357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:32.654821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:32.663088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 472/941] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:32.669313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:32.769448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842421fb-253f-4a7e-a5ab-55369c02eda6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:32.804391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:32.805175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:32.805473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:32.805743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:32.817216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:32.818800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:32.835634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:32.836838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:32.837907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:32.837907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:32.837907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:32.837907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 470/942] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:32.843626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:32.846683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:32.948805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3719df-b570-4cd2-a1ef-c3dc2637cbb3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:32.987421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:32.988208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:32.988374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:32.988657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:32.989386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:32.989733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:32.991451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.005481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 473/943] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:33.011594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:33.059403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:33.121612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f491a9-dea4-4882-a7dd-71e78e0f3a03 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:33.158302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:33.158984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:33.159255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:33.159508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:33.167316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:33.168840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:32:33.180183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:33.181513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:33.182761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 471/944] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:33.187985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:33.261028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:33.302204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e584-53f7-44fe-93ca-010221f508be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:33.339198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:33.339839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:33.340133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:33.340365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:33.341196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:33.341551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:33.343094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.361457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 474/945] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:33.367563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:33.481228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e73b88-23fe-4f34-8484-812ec820efee None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:33.482783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:33.516556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:33.517321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:33.517570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:33.517841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:33.530793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:33.532252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:33.547942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:33.549113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:33.549981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:33.549981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:33.549981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:33.549981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 472/946] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:33.555346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:33.657024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c0f5-9a8e-4e56-b03e-086bc1d2cace None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:33.677973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:33.693527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:33.694138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:33.694407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:33.694673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:33.695302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:33.695596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:33.696970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.709406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 475/947] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:33.715936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:33.833134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612ae6-86fb-4dbb-9743-784d113c3ea2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:33.871733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:33.872447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:33.872718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:33.872981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:33.880230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:33.881915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:32:33.893751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:33.894851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:33.895888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 473/948] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:33.901298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:34.020977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288fbe6-273c-4b3e-a3c6-e10e2a261ab1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:34.059492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:34.060217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:34.060548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:34.060821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:34.061635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:34.061938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:34.063391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7cf5-666b-48c3-8883-41054fc52290 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:34.076145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 476/949] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:34.083294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:34.102872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:34.215326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05079bc-450c-4452-a8b4-933f41125c63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:34.258360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:34.259611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:34.260052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:34.260551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] PATH_INFO: `/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d2b49f6dc22e4831951be6d7192226c9/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:34.263592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec6b8f1321034cbeabf9632b50726f21, user_id=d2b49f6dc22e4831951be6d7192226c9, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:34.265887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56de0d0-51b4-4f6e-a0ab-1096611274a8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:34.283734 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 474/950] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 11 06:32:34 2022] PUT /identity/v3/projects/ec6b8f1321034cbeabf9632b50726f21/users/d2b49f6dc22e4831951be6d7192226c9/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:32:36.514515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff2d4-9cd5-41bf-bd66-bb38034b15c9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:36.515057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff2d4-9cd5-41bf-bd66-bb38034b15c9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:36.515190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff2d4-9cd5-41bf-bd66-bb38034b15c9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:36.516572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 477/951] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:36.525040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:36.525040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:36.525040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:36.542896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:36.544106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:36.616498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 475/952] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:36.883008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ff2d4-9cd5-41bf-bd66-bb38034b15c9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:36.928841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:36.993095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ff2d4-9cd5-41bf-bd66-bb38034b15c9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.030372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.030999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.031315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.031673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.045781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 06:32:37.051461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:37.052556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:37.053642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 478/953] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 11 06:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:37.061315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.064523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:37.171856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07858-2c3a-4363-be73-d2f4e3b3435f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.213166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.213166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.213166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.213166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.214097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:37.214435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:37.216095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:37.226496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 476/954] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:37.233930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.345170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:37.349316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72a0d7-4029-49ef-86e6-f2aced0f9382 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.388172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.388934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.389267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.389874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.401170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:37.402613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:37.418689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:37.419904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:37.420816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:37.420816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:37.420816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:37.425073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 479/955] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:37.426055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.506333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:37.542962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dcb1-233c-412e-ae80-056e85455e6f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.583333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.584061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.584408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.584699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.585426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:37.585722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:37.587177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:37.599446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 477/956] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:37.605341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.712690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb1f30-e0c0-4e91-8294-d7b54bdf782a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.750319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.751093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.751552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.751846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.760898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:37.762422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 06:32:37.774492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:37.776068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:37.777462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 480/957] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 06:32:37.782123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.889096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29a82-69f0-4aff-b876-d5a07ce27fdd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:37.917146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:37.926161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:37.926842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:37.927162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:37.927409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:37.928130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:37.928429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:37.930027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:37.948555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 478/958] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:37.955601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:37.972864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:38.068562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7042c-4474-4a4b-a59b-5e297152d512 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:38.110553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:38.111184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:38.111462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:38.111733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:38.185777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:38.187307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:38.205147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:38.305610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 481/959] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 11 06:32:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 06:32:38.311769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:38.421489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7032b-33e0-47a1-b6f2-971ea9bde70b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:38.459957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:38.460604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:38.460872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:38.461176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:38.472635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:38.474142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 06:32:38.490883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:38.492088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 06:32:38.493029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 06:32:38.493029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 06:32:38.493029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:38.493029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 479/960] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:38.498587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:38.600727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282f42-79f8-4b42-be5d-596a33731b7e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:38.614921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:38.637897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:38.638510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:38.638767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:38.639051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:38.639687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:38.639983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:38.641400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:38.653737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 482/961] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 11 06:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:38.659409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:38.696191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:38.761606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7fd63-61df-41d1-ac16-819eb11beb36 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:38.794799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:38.795415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:38.795683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:38.795943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:38.802403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:38.803911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 06:32:38.814909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:38.815922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Oct 11 06:32:38.817586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 480/962] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 11 06:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:38.828279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:38.947602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37806cb9-3507-4448-a0fb-80dde41a169d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:38.982887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:38.983480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:38.983749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:38.984008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:38.984686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:38.984982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:38.986428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d709-4178-4ce9-a791-96fe7f8d66c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:38.998885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 483/963] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 11 06:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:39.005503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:39.105446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:39.112466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a048f2-ca7e-43a1-9e1b-ef84b30d9471 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:39.147598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:39.148188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:39.148457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:39.148749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:39.149485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] RBAC: Adding query filter params (role.id=b04fbf57ace9402ca3e538592635ef5f, scope.project.id=ec6b8f1321034cbeabf9632b50726f21, user.id=d2b49f6dc22e4831951be6d7192226c9) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:39.149783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:39.151201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e5a1-f982-4742-a6e1-fef1b8b63006 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:39.156662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 481/964] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 11 06:32:39 2022] GET /identity/v3/role_assignments?user.id=d2b49f6dc22e4831951be6d7192226c9&scope.project.id=ec6b8f1321034cbeabf9632b50726f21&role.id=b04fbf57ace9402ca3e538592635ef5f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:41.303557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8506-078c-4f8e-96a8-1d60d6503b93 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:41.304488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8506-078c-4f8e-96a8-1d60d6503b93 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:41.304488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8506-078c-4f8e-96a8-1d60d6503b93 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:41.306620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 484/965] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:41.312906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:41.313744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:41.313897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:41.340294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:41.341521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:41.408894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 482/966] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:41.676589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8506-078c-4f8e-96a8-1d60d6503b93 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:41.715465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:41.795887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8506-078c-4f8e-96a8-1d60d6503b93 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:41.830547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:41.831101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:41.831373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:41.831635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:41.832215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:41.833614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:41.842443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:41.843635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:41.844958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 485/967] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:32:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:41.851175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:41.938057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:41.954203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9292-ad26-4ff6-abbd-6f44b36b2c0a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:41.988730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:41.989380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:41.989623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:41.989887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:41.990538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:41.990832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:41.992190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a44d7-bef3-48fa-ac02-2fb8570bc0ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:41.996820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 483/968] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 11 06:32:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:42.002834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:42.116616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:42.123202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f166a-d343-4204-968b-e5a6906e91b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:42.157848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:42.158432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:42.158679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:42.158957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:42.159569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:42.159866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:42.161250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918001a-9a50-47da-971e-38ae3a981ce0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:42.165860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 486/969] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 11 06:32:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:44.292508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f09c5-10c7-4c2d-a530-6458745b54d2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:44.293122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f09c5-10c7-4c2d-a530-6458745b54d2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:44.293122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f09c5-10c7-4c2d-a530-6458745b54d2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:44.294409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 484/970] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:44.300760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d88a-b090-44b3-b691-4a44106ba080 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:44.301557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d88a-b090-44b3-b691-4a44106ba080 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:44.301699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53d88a-b090-44b3-b691-4a44106ba080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:44.323018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cc53d88a-b090-44b3-b691-4a44106ba080 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:44.324245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc53d88a-b090-44b3-b691-4a44106ba080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:44.397726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:44.663007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f09c5-10c7-4c2d-a530-6458745b54d2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:44.771042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f09c5-10c7-4c2d-a530-6458745b54d2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:44.806353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:44.806941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:44.807213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:44.807483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:44.808143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:44.809551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346b142-b257-4e17-ba40-81c6bca3e290 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:44.832832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 485/972] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 11 06:32:44 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:32:46.979471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e4b3-87f4-4954-99ec-26153ca2f7de None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:46.980379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e4b3-87f4-4954-99ec-26153ca2f7de None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:46.980379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707e4b3-87f4-4954-99ec-26153ca2f7de None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:46.982507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 488/973] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:46.988847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:46.989608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:46.989786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:47.015034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:47.016233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:47.029605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:47.098001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 486/974] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:47.379340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707e4b3-87f4-4954-99ec-26153ca2f7de None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:47.481146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:47.499648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707e4b3-87f4-4954-99ec-26153ca2f7de None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:47.538417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:47.539039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:47.539315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:47.539582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:47.540171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:47.541579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:47.550691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:47.551845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:47.553095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 489/975] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:32:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:47.558207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:47.664947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7236d-8f14-4e6c-ad0c-77d57a88ea56 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:47.700938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:47.701566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:47.701838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:47.702104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:47.702727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:47.703026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:47.704752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:47.709868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 487/976] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 11 06:32:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:32:47.716001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:47.826959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84899ca9-9f34-4c01-b897-a68cccc71267 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:47.862528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:47.863119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:47.863386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:47.863649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:47.864334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] RBAC: Adding query filter params (interface=public, service_id=511917405ee84333b1d9228d8feeb525, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:47.864636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:47.866084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c1dcc-1089-4cae-8caa-764a4e17b949 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:47.871104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 490/977] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 11 06:32:47 2022] GET /identity/v3/endpoints?service_id=511917405ee84333b1d9228d8feeb525&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:47.877192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:47.881288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:47.984432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274506c6-4133-4dfb-9d5f-60b600d44070 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:48.019659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:48.020269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:48.020504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:48.020766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:48.021464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:48.022817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536db4-5888-4a9b-aad8-490c1c32edfd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:48.029592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 488/978] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 11 06:32:47 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:32:50.147257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774b3a-628b-45e4-bead-010555722d06 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:50.148175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774b3a-628b-45e4-bead-010555722d06 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:50.148175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774b3a-628b-45e4-bead-010555722d06 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:50.150382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 491/979] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:32:50.156709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:50.157167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:50.157278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:50.183938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:32:50.185160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:32:50.259561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:50.266366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 489/980] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:32:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 06:32:50.532262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774b3a-628b-45e4-bead-010555722d06 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:50.554336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:50.641629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774b3a-628b-45e4-bead-010555722d06 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:50.679197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:50.679819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:50.680090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:50.680353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:50.680931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:50.682400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 06:32:50.691741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 06:32:50.692899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Oct 11 06:32:50.693878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 492/981] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 11 06:32:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 06:32:50.701258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:50.810621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb41a0-badb-4b1a-8e45-287fea2728ea None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:50.846456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:50.847053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:50.847327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:50.847589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:50.848212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:32:50.848512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:50.849947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2371db-ea4e-4f33-919d-3b28dc4c5d48 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:50.855133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 490/982] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 11 06:32:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:32:50.861588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:32:50.955875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:32:50.978349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150575ca-39cd-4e2c-bc27-5546ad09ca4f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:32:51.018116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:32:51.018706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:32:51.018982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:32:51.019247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:32:51.019909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:32:51.021336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4efa4-08b4-429c-b2de-afc6cd4ae34c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:32:51.048687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 493/983] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:32:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:33:00.852152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=69 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:33:01.041309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:33:54.759324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786320e6-80c4-47e0-873b-f2bdbde4c538 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:54.760419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786320e6-80c4-47e0-873b-f2bdbde4c538 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:54.761329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786320e6-80c4-47e0-873b-f2bdbde4c538 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:54.768814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 491/984] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:33:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:33:54.769500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f54c-af59-451b-816b-5bed29314624 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:54.769918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f54c-af59-451b-816b-5bed29314624 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:54.769918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38f54c-af59-451b-816b-5bed29314624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:54.910650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3e38f54c-af59-451b-816b-5bed29314624 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:33:54.912479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e38f54c-af59-451b-816b-5bed29314624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:55.057798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:33:55.354696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:55.355275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:55.355697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:55.357451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 492/986] 10.222.0.30 () {54 vars in 964 bytes} [Tue Oct 11 06:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:33:55.364501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d041-908f-41b5-b8d3-db7b16dac1e7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:55.365064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d041-908f-41b5-b8d3-db7b16dac1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:55.365496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d041-908f-41b5-b8d3-db7b16dac1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:55.465056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f541d041-908f-41b5-b8d3-db7b16dac1e7 None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:33:55.466739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f541d041-908f-41b5-b8d3-db7b16dac1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:55.495355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:33:55.573656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 495/987] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Oct 11 06:33:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:33:55.583584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:33:55.585796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:55.722544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e7a81-408f-478d-afdc-12f0c6eef7df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:33:55.810962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:33:55.811722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:55.812032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:55.812494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:55.814308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:55.882674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:33:55.946479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:33:55.948308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445566a-e08e-4428-a1ea-0d0c24e275f7 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:33:55.970115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 493/988] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:33:58.439412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:58.440234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:58.440350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:58.442580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 496/989] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:33:58.448014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b2b8-c12d-4a22-89f7-b7e04211be68 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:58.448429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b2b8-c12d-4a22-89f7-b7e04211be68 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:58.448538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759b2b8-c12d-4a22-89f7-b7e04211be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:58.533126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f759b2b8-c12d-4a22-89f7-b7e04211be68 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:33:58.534397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f759b2b8-c12d-4a22-89f7-b7e04211be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:58.635968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 494/990] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:33:58.913765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:33:58.916719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:59.036612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b977a-c5d2-4091-a65b-56c424ac28c8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:33:59.113827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:33:59.116451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:33:59.117102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:33:59.117388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:33:59.117665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:33:59.119955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:33:59.234998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:33:59.236356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e61d-60d4-46cf-9a16-0337e3629851 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:33:59.256230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 497/991] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:01.718570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:01.719417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:01.719417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:01.721515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 495/992] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:01.727892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a8f94-3adf-4c94-b7f8-699e64a14c09 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:01.728350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a8f94-3adf-4c94-b7f8-699e64a14c09 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:01.728449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a8f94-3adf-4c94-b7f8-699e64a14c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:01.805352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-599a8f94-3adf-4c94-b7f8-699e64a14c09 None None] MFA Rules not processed for user `dc103268404f463d974136311a405915`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:01.806567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-599a8f94-3adf-4c94-b7f8-699e64a14c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:01.860470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:01.914856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 498/993] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:02.199390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:02.201152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:02.211886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:02.315201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277f91-921f-4e23-974a-d982b96e4418 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:02.390808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:02.391400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:02.391675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:02.391940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:02.393659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:02.457271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:02.508853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:02.510302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96455fdf-4c50-4c54-868f-742a35cc0053 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:02.528669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 496/994] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:05.185076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:05.185949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:05.185949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:05.188020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 499/995] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:05.196208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caae88-2dcc-4732-8a67-804b459e417e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:05.196709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caae88-2dcc-4732-8a67-804b459e417e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:05.196709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caae88-2dcc-4732-8a67-804b459e417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:05.267648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c8caae88-2dcc-4732-8a67-804b459e417e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:05.268900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c8caae88-2dcc-4732-8a67-804b459e417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:05.376673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 497/996] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:34:05.662239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:05.663787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:05.769799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339bd2-9e63-4f19-8f97-97c4c4182205 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:05.844885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:05.845433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:05.845709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:05.846001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:05.847582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:05.854787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:05.965982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:05.967428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854fc4-04d8-4a18-a6d5-e6b05ff1cfb3 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:05.986544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 500/997] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:34:08.778493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad0f9-9361-4d25-9b0e-3d5367c2d367 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:08.779066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad0f9-9361-4d25-9b0e-3d5367c2d367 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:08.779066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad0f9-9361-4d25-9b0e-3d5367c2d367 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:08.780495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 498/998] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:08.785998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3079-6471-4e46-8da4-224e8bc9c6de None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:08.786385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3079-6471-4e46-8da4-224e8bc9c6de None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:08.786554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3079-6471-4e46-8da4-224e8bc9c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:08.860855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-28ed3079-6471-4e46-8da4-224e8bc9c6de None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:08.862051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-28ed3079-6471-4e46-8da4-224e8bc9c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:08.928362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:08.972890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 501/999] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:09.267284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:09.267661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:09.267934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:09.269355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 499/1000] 10.222.0.30 () {54 vars in 964 bytes} [Tue Oct 11 06:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:09.275372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc720-0fd5-4de5-8a37-7fbfc24259d9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:09.275649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc720-0fd5-4de5-8a37-7fbfc24259d9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:09.275947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc720-0fd5-4de5-8a37-7fbfc24259d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:09.355108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bbbbc720-0fd5-4de5-8a37-7fbfc24259d9 None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:09.356326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bbbbc720-0fd5-4de5-8a37-7fbfc24259d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:09.436455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 502/1001] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Oct 11 06:34:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:09.445800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:09.447333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:09.468707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:09.553088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb92e-589c-4afd-80ad-a62d44b90c1a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:09.630130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:09.630753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:09.631028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:09.631297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:09.632896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:09.707262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:09.747952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:09.749435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191130-b1d9-4cc4-85f8-892a760fc6cb service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:09.767649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 500/1002] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:12.204824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:12.205491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:12.205491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:12.207082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 503/1003] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:12.212427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa5d9-767b-4079-9a88-814d1c006e75 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:12.212876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa5d9-767b-4079-9a88-814d1c006e75 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:12.213039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fa5d9-767b-4079-9a88-814d1c006e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:12.280809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d54fa5d9-767b-4079-9a88-814d1c006e75 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:12.281920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d54fa5d9-767b-4079-9a88-814d1c006e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:12.383444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 501/1004] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:12.658649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:12.660227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:12.725975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:12.770141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808e5aa-95ba-4033-82bf-0bcf14ab74bf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:12.844022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:12.844542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:12.844819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:12.845108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:12.846705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:12.957731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:12.960492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:12.962367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f3437-4b91-4648-962b-d3ac0bf9175a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:12.981322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 504/1005] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:15.195183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:15.195740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:15.195740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:15.197360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 502/1006] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:15.203687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa761f-1fa4-4946-aece-21850ede9a0c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:15.204215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa761f-1fa4-4946-aece-21850ede9a0c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:15.204215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa761f-1fa4-4946-aece-21850ede9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:15.276394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ecaa761f-1fa4-4946-aece-21850ede9a0c None None] MFA Rules not processed for user `dc103268404f463d974136311a405915`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:15.277652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ecaa761f-1fa4-4946-aece-21850ede9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:15.378703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 505/1007] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:15.654164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:15.655785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:15.688765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:15.764196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5083f4-3944-4d3e-938b-f73072024d9b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:15.841028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:15.841655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:15.841901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:15.842187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:15.843768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:15.930760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:15.966210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:15.967640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71fb0f-ca74-4438-a55f-99479340d1cb service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:15.987899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 503/1008] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:18.517885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:18.518736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:18.518885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:18.520319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 506/1009] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:18.526610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba146-da96-45e2-80dc-1e9b5c4b84a9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:18.527051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba146-da96-45e2-80dc-1e9b5c4b84a9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:18.527141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba146-da96-45e2-80dc-1e9b5c4b84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:18.603617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2f8ba146-da96-45e2-80dc-1e9b5c4b84a9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:18.604838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2f8ba146-da96-45e2-80dc-1e9b5c4b84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:18.703513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 504/1010] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:18.985347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:18.986971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:19.059638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:19.095232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418dda2-e592-4b48-9603-e825878ddb84 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:19.176326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:19.176920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:19.177218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:19.177482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:19.179072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:19.290209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:19.291540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db4d36-1a90-4efe-82fb-768f8badf738 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:19.301737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:19.310949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 507/1011] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:34:21.502090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:21.503010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:21.503010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:21.504716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 505/1012] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:21.512411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c11f9-1ba4-4a00-949f-4fb69b30264d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:21.512831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c11f9-1ba4-4a00-949f-4fb69b30264d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:21.512947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c11f9-1ba4-4a00-949f-4fb69b30264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:21.581479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2d1c11f9-1ba4-4a00-949f-4fb69b30264d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:21.582718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2d1c11f9-1ba4-4a00-949f-4fb69b30264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:21.676759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 508/1013] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:21.961883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:21.964276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:22.015529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:22.083256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef76bb-4d2c-4fab-a1e2-97fabfbca056 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:22.161827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:22.162420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:22.162692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:22.162961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:22.164559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:22.256172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:22.282460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:22.283923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03596e-e439-4e51-b3a9-125951dbf784 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:22.303206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 506/1014] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:24.808355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:24.809306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:24.809306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:24.811434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 509/1015] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:24.817093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b362d4-a0ef-4f52-98de-e7f78e724d2f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:24.817533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b362d4-a0ef-4f52-98de-e7f78e724d2f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:24.817638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b362d4-a0ef-4f52-98de-e7f78e724d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:24.887466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b4b362d4-a0ef-4f52-98de-e7f78e724d2f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:24.888664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b4b362d4-a0ef-4f52-98de-e7f78e724d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:24.992745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 507/1016] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:25.285924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:25.288425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:25.374449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:25.405089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a9c6-feba-4ca8-940c-d3ea40ab3f87 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:25.480828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:25.481455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:25.481728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:25.481994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:25.483598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:25.598782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:25.600226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d55b8-0322-4860-9379-0a710f32305a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:25.619894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 510/1017] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:29.742909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:29.743462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:29.743462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:29.745043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 508/1018] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:29.750107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5042-93d4-4e9f-815a-31361822367e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:29.750544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5042-93d4-4e9f-815a-31361822367e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:29.750629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5042-93d4-4e9f-815a-31361822367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:29.756358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:29.818109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6bdb5042-93d4-4e9f-815a-31361822367e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:29.819202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6bdb5042-93d4-4e9f-815a-31361822367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:29.919247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 511/1019] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:30.197129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:30.198758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:30.249687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:30.307639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de68095-4fa5-4674-bb63-00fe18633b35 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:30.385826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:30.386437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:30.386708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:30.386971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:30.388556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:30.485895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:30.503316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:30.504752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c052-f9aa-408c-81f2-fdc502440993 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:30.523228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 509/1020] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:33.445676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:33.446225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:33.446225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:33.447577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 512/1021] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:33.453420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904e95-357b-487a-a467-37e2be45ac79 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:33.453838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904e95-357b-487a-a467-37e2be45ac79 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:33.454008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904e95-357b-487a-a467-37e2be45ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:33.529764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-23904e95-357b-487a-a467-37e2be45ac79 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:33.531015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23904e95-357b-487a-a467-37e2be45ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:33.634697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 510/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:33.919625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:33.921206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:34.010975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:34.033311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9669-7044-421e-b9b8-6b2051efbd8b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:34.109611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:34.110219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:34.110493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:34.110739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:34.112332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:34.258017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:34.259485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91ae5-ecb4-4852-9b8e-4fa48326b556 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:34.278948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 513/1023] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:38.548744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:38.549339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:38.549339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:38.550710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 511/1024] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:38.556153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67471-0ab6-40b0-9a5d-ddba455dc305 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:38.556591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67471-0ab6-40b0-9a5d-ddba455dc305 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:38.556701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d67471-0ab6-40b0-9a5d-ddba455dc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:38.575584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:38.633164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-95d67471-0ab6-40b0-9a5d-ddba455dc305 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:38.634385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95d67471-0ab6-40b0-9a5d-ddba455dc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:38.735301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 514/1025] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:39.021622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:39.023183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:39.084575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:39.144080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f757fe-b2b1-44f2-ae21-1b499b7dca0e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:39.229613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:39.230252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:39.230530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:39.230797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:39.232403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:39.344882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:39.348745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:39.350492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa4814-b7fa-4fce-befc-33c23c71f832 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:39.369540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 512/1026] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:44.313506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac2ff-aff7-4c49-a7dc-2b4cf7bdee35 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:44.313506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac2ff-aff7-4c49-a7dc-2b4cf7bdee35 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:44.313506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac2ff-aff7-4c49-a7dc-2b4cf7bdee35 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:44.313506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 515/1027] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:44.314195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e36b3-174c-4c95-ac69-d466831df076 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:44.314195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e36b3-174c-4c95-ac69-d466831df076 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:44.314195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e36b3-174c-4c95-ac69-d466831df076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:44.455368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ba0e36b3-174c-4c95-ac69-d466831df076 None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:44.457027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ba0e36b3-174c-4c95-ac69-d466831df076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:44.586275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 513/1028] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:34:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:48.729146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f34b-a63d-41b5-8d1d-c49cac154641 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:48.729696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f34b-a63d-41b5-8d1d-c49cac154641 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:48.729943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f34b-a63d-41b5-8d1d-c49cac154641 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:48.731362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 516/1029] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:48.733825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=59 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:48.737354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02024b1-3513-44bb-a0dc-2c5bad25072f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:48.738229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02024b1-3513-44bb-a0dc-2c5bad25072f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:48.738788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02024b1-3513-44bb-a0dc-2c5bad25072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:48.798087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:48.826944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c02024b1-3513-44bb-a0dc-2c5bad25072f None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:48.828550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c02024b1-3513-44bb-a0dc-2c5bad25072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:48.956935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 514/1030] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:34:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:50.096208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd81e-4c8a-449e-a34f-e2ec6ae99bfb None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:50.096767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd81e-4c8a-449e-a34f-e2ec6ae99bfb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:50.096767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd81e-4c8a-449e-a34f-e2ec6ae99bfb None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:50.098135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 517/1031] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:50.103396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e515-4a4a-49d0-9206-2bf349a1002d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:50.103830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e515-4a4a-49d0-9206-2bf349a1002d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:50.104121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59e515-4a4a-49d0-9206-2bf349a1002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:50.192387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8b59e515-4a4a-49d0-9206-2bf349a1002d None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:50.193627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b59e515-4a4a-49d0-9206-2bf349a1002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:50.238537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:50.307231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 515/1032] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:34:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:53.846048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49074-b676-4955-8e9a-89893aef2ef8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:53.846623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49074-b676-4955-8e9a-89893aef2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:53.846623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49074-b676-4955-8e9a-89893aef2ef8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:53.848298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 518/1033] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:53.853588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78a02-e3ab-414d-8176-c3bf1477a853 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:53.854037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78a02-e3ab-414d-8176-c3bf1477a853 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:53.854146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78a02-e3ab-414d-8176-c3bf1477a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:53.926917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-edc78a02-e3ab-414d-8176-c3bf1477a853 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:53.928188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-edc78a02-e3ab-414d-8176-c3bf1477a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:54.028395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 516/1034] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:54.330782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:54.331067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:54.331339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:54.332691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 519/1035] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:54.346646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afeb7-8ceb-47a5-97b0-d366d68a4aaf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:54.347190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afeb7-8ceb-47a5-97b0-d366d68a4aaf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:54.347692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192afeb7-8ceb-47a5-97b0-d366d68a4aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:54.367798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:54.430528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-192afeb7-8ceb-47a5-97b0-d366d68a4aaf None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:54.431937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-192afeb7-8ceb-47a5-97b0-d366d68a4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:54.570644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 517/1036] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:34:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:34:54.578989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:54.580731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:54.733422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca43bb-05a1-4b5f-9287-0d3dc6039cb9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:54.811639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:54.855343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:54.855947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:54.856229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:54.856497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:54.858140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:54.961009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:54.962964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680c1fe-59bc-4039-822e-f653086fd9d0 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:54.982666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 520/1037] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:34:57.351203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:57.351203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:57.352019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:57.356845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 518/1038] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:34:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:34:57.358425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefeeef-7e3f-4d5e-980c-ca11ec93eab5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:57.358901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefeeef-7e3f-4d5e-980c-ca11ec93eab5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:57.358901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefeeef-7e3f-4d5e-980c-ca11ec93eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:57.448660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7cefeeef-7e3f-4d5e-980c-ca11ec93eab5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:34:57.449999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7cefeeef-7e3f-4d5e-980c-ca11ec93eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:57.495032 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:57.569739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 521/1039] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:34:57.859195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:34:57.860743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:57.930126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:58.038011 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c8ed6-ab17-4b4e-82bb-71548ddc5925 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:34:58.168594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:34:58.169246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:34:58.169519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:34:58.169783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:34:58.171386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:34:58.194338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:34:58.267731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:34:58.269361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e26dde-9ae3-4a0f-ab8c-71287f6e5c8c service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:34:58.287771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 519/1040] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:00.760652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769db0f-44f9-4f26-bd24-1de9f8141b56 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:00.761263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769db0f-44f9-4f26-bd24-1de9f8141b56 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:00.761263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769db0f-44f9-4f26-bd24-1de9f8141b56 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:00.762938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 522/1041] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:00.768514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c096d-6e52-4d04-bcbc-c7becdc44f6b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:00.768971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c096d-6e52-4d04-bcbc-c7becdc44f6b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:00.769116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c096d-6e52-4d04-bcbc-c7becdc44f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:00.838255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a33c096d-6e52-4d04-bcbc-c7becdc44f6b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:00.839461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a33c096d-6e52-4d04-bcbc-c7becdc44f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:00.941624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:00.944807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 520/1042] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:01.229371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:01.229657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:01.229936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:01.231346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 523/1043] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:01.237046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335ef3-374b-4e88-b6e3-0d50454e4603 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:01.237337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335ef3-374b-4e88-b6e3-0d50454e4603 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:01.237699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335ef3-374b-4e88-b6e3-0d50454e4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:01.316257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c7335ef3-374b-4e88-b6e3-0d50454e4603 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:01.317491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c7335ef3-374b-4e88-b6e3-0d50454e4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:01.438209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 521/1044] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:35:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:01.446436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:01.448053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:01.607270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de763291-b1fe-46c9-af91-22ead9ba3579 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:01.629195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:01.731223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:01.732127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:01.732392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:01.732667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:01.734334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:01.835644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:01.837206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c336a6-83e0-43c4-864a-da2313e29645 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:01.856475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 524/1045] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:35:01.885712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007648e-20d5-4342-9960-1d8f4b9f4989 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:01.887193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007648e-20d5-4342-9960-1d8f4b9f4989 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:01.887775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007648e-20d5-4342-9960-1d8f4b9f4989 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:01.893922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 522/1046] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:01.896120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951808ed-9663-42b2-a3fc-4fda69402706 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:01.896505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951808ed-9663-42b2-a3fc-4fda69402706 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:01.897039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951808ed-9663-42b2-a3fc-4fda69402706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:01.932836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:01.987050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-951808ed-9663-42b2-a3fc-4fda69402706 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:01.988410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-951808ed-9663-42b2-a3fc-4fda69402706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:02.109502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 525/1047] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:02.443428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:02.443428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:02.443428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:02.444719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 523/1048] 10.222.0.30 () {54 vars in 963 bytes} [Tue Oct 11 06:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:02.449682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841141-0eda-4fde-b355-dc939ba71dc6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:02.450424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841141-0eda-4fde-b355-dc939ba71dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:02.450788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89841141-0eda-4fde-b355-dc939ba71dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:02.530883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-89841141-0eda-4fde-b355-dc939ba71dc6 None None] MFA Rules not processed for user `d21a5a40ab384688bb267a44a749f085`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:02.532224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-89841141-0eda-4fde-b355-dc939ba71dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:02.592286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:02.626177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 526/1049] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Oct 11 06:35:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:02.634164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:02.635912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:02.690777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:02.749204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e1346-d65b-47c9-9573-24188a396cfe None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:02.831619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:02.832267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:02.832534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:02.832801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:02.834611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:02.949742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:02.967792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:02.969274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71af88-be8f-4382-bc6b-1cac3e1c9a77 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:02.990409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 524/1050] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:04.081529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:04.082100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:04.082100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:04.083402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 527/1051] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:04.088790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a18e1-0cfa-4684-878f-a163524cde5c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:04.089241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a18e1-0cfa-4684-878f-a163524cde5c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:04.089333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a18e1-0cfa-4684-878f-a163524cde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:04.156321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e53a18e1-0cfa-4684-878f-a163524cde5c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:04.157742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e53a18e1-0cfa-4684-878f-a163524cde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:04.259931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 525/1052] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:04.554281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:04.555967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:04.704471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adddfbb-58b6-4af8-9c9f-44ed2bfda477 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:04.756753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:04.820849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:04.821483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:04.821761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:04.822025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:04.823630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:04.917125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:04.918731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbdf27-0987-4145-ac01-750c4a948fbc service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:04.937023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 528/1053] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:07.139025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:07.139605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:07.139605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:07.141099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 526/1054] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:07.146336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7381e-8b98-4b6d-8eff-ebe00c90b062 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:07.146823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7381e-8b98-4b6d-8eff-ebe00c90b062 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:07.146932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7381e-8b98-4b6d-8eff-ebe00c90b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:07.220505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-84c7381e-8b98-4b6d-8eff-ebe00c90b062 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:07.221754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-84c7381e-8b98-4b6d-8eff-ebe00c90b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:07.229653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:07.324721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 529/1055] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:07.607858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:07.609428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:07.673483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:07.764577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9660fb-4fb7-41e6-956b-5de4bf3b766e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:07.883940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:07.884675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:07.884947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:07.885242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:07.886843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:07.906647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:07.983851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:07.985499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a30e3-1172-4fc2-b002-b8e55bfe3d87 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:08.005115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 527/1056] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:10.204235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:10.204718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:10.204884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:10.206139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 530/1057] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:35:10.211652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f5f-3c7f-4ca2-b39f-b2042d09300a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:10.212079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f5f-3c7f-4ca2-b39f-b2042d09300a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:10.212348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79f5f-3c7f-4ca2-b39f-b2042d09300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:10.345245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03c79f5f-3c7f-4ca2-b39f-b2042d09300a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:10.346396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03c79f5f-3c7f-4ca2-b39f-b2042d09300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:10.447994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:10.455553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 528/1058] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:10.828250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:10.830261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:10.997450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:11.009676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965e2ec-4345-4363-a3a5-210c5f2bcd96 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:11.133422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:11.134567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:11.134988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:11.135408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:11.137964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:11.239964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:11.241703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486aff1-a20a-4b62-9daa-da093a9dbca1 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:11.253218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:11.266652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 531/1059] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:13.549793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:13.550617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:13.550617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:13.552272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 529/1060] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:13.558944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febc-33b0-4c27-b51b-d9895cc5b938 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:13.559475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febc-33b0-4c27-b51b-d9895cc5b938 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:13.559767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4febc-33b0-4c27-b51b-d9895cc5b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:13.632951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8ab4febc-33b0-4c27-b51b-d9895cc5b938 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:13.634323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8ab4febc-33b0-4c27-b51b-d9895cc5b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:13.740720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 532/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:14.114248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:14.116349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:14.280421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1efe5a-e8e0-490b-94ca-0179edbaf69b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:14.360156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:14.419385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:14.420111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:14.420492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:14.420808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:14.422777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:14.547632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:14.550768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72410ab-f112-431c-9383-75596b6360ac service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:14.577458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 530/1062] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:16.853135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:16.853710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:16.853710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:16.855072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 533/1063] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:16.860398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945de6-a4ff-4cf1-b723-2a348249363d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:16.860864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945de6-a4ff-4cf1-b723-2a348249363d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:16.860971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945de6-a4ff-4cf1-b723-2a348249363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:16.926694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa945de6-a4ff-4cf1-b723-2a348249363d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:16.927956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa945de6-a4ff-4cf1-b723-2a348249363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:16.961495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:17.024680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 531/1064] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:17.305516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:17.307104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:17.386065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:17.459748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a08fbb-13b3-4226-b689-b1d424c45861 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:17.578081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:17.578704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:17.578977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:17.579244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:17.580818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:17.620363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:17.671391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:17.672991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75058f6e-b5de-45bd-9d33-8aaa11b5ac0c service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:17.690927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 534/1065] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:18.038474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88642-4808-489d-bdb2-48efbf543d81 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:18.039036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88642-4808-489d-bdb2-48efbf543d81 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:18.039036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd88642-4808-489d-bdb2-48efbf543d81 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:18.040379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 532/1066] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:18.045856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a007-dcf6-4fc9-bf4f-d34760572157 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:18.046342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a007-dcf6-4fc9-bf4f-d34760572157 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:18.046342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a007-dcf6-4fc9-bf4f-d34760572157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:18.114509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-67f5a007-dcf6-4fc9-bf4f-d34760572157 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:18.115790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-67f5a007-dcf6-4fc9-bf4f-d34760572157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:18.219138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 535/1067] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:18.516071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:18.516346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:18.516569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:18.518378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 533/1068] 10.222.0.30 () {54 vars in 962 bytes} [Tue Oct 11 06:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:18.524119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c20-31e1-4c44-8098-48161b80b5a4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:18.524402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c20-31e1-4c44-8098-48161b80b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:18.524742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51c20-31e1-4c44-8098-48161b80b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:18.541385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:18.624757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e8b51c20-31e1-4c44-8098-48161b80b5a4 None None] MFA Rules not processed for user `70f7e360a0824d328c393df1eacbc06e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:18.626438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e8b51c20-31e1-4c44-8098-48161b80b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:18.713404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 536/1069] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Oct 11 06:35:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:18.722565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:18.724077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:18.834173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324a004-1807-4a82-bc45-ae0808bc1281 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:18.893269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:18.908941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:18.909589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:18.909854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:18.910119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:18.911699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:19.022037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:19.023487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83f2e3-edb1-4308-bc65-7cb3d5763c51 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:19.042128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 534/1070] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:35:19.792941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2805-9c78-47d4-b10e-6f658d50f141 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:19.793551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2805-9c78-47d4-b10e-6f658d50f141 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:19.793683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b2805-9c78-47d4-b10e-6f658d50f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:19.863454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-841b2805-9c78-47d4-b10e-6f658d50f141 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:19.864719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-841b2805-9c78-47d4-b10e-6f658d50f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:19.889560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b039-87f5-47f5-b2e2-0096c8d99a5c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:19.889799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b039-87f5-47f5-b2e2-0096c8d99a5c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:19.890094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826b039-87f5-47f5-b2e2-0096c8d99a5c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:19.891414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 535/1071] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:35:19.896846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:19.897163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:19.897457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:19.922811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:19.956079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 537/1072] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:35:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:19.964069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:19.965653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.004251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cf58-017a-493c-888b-3562ba31f4f3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:20.004709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cf58-017a-493c-888b-3562ba31f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:20.004983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0cf58-017a-493c-888b-3562ba31f4f3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:20.006522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 538/1073] 10.222.0.30 () {54 vars in 943 bytes} [Tue Oct 11 06:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:35:20.008703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:20.013077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:20.013472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:20.013746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:20.075911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 536/1074] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:20.099444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] MFA Rules not processed for user `7f4ea301b8f046c3b9a7e4737775c5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:20.100653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.207037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 539/1075] 10.222.0.30 () {58 vars in 1040 bytes} [Tue Oct 11 06:35:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:35:20.216667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:20.217923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.322633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3fa8-da68-40f6-b122-e5048ecd6bac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:20.370804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:20.372043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.397581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:20.405366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:20.443542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:20.444163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:20.444433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:20.444701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:20.446365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.472516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7dea-b18e-4f6a-b869-52cd4a50ec59 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:20.534307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:20.535902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de50164-9b1b-4186-bbd7-780cf5246617 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:20.543806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 537/1076] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:35:20.595511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:20.596133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:20.596408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:20.596773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:20.598310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:20.656491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:20.709076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:20.710696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035b0b5-8669-4386-9910-8d9d6d696d9f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:20.731976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 540/1077] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:22.941965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:22.942542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:22.942542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:22.943890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 538/1078] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:22.949371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c2157-b2ba-454d-bbca-e57ce4160cbf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:22.950179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c2157-b2ba-454d-bbca-e57ce4160cbf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:22.950179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c2157-b2ba-454d-bbca-e57ce4160cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:23.022148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e7c2157-b2ba-454d-bbca-e57ce4160cbf None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:23.023381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e7c2157-b2ba-454d-bbca-e57ce4160cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:23.133149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 541/1079] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:23.425798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:23.427727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:23.533523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:23.587296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45561-ba24-4f77-885d-31f1b57a7146 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:23.710381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:23.710910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:23.711177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:23.711449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:23.713078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:23.781793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:23.809396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:23.811028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fdf92-f41b-4125-a311-c82fcd6fcb1a service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:23.831259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 539/1080] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:26.024716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:26.025349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:26.025349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:26.027013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 542/1081] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:26.032491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da8db-589b-4546-a718-5f5cc7d5206c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:26.033042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da8db-589b-4546-a718-5f5cc7d5206c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:26.033302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da8db-589b-4546-a718-5f5cc7d5206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:26.104005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-944da8db-589b-4546-a718-5f5cc7d5206c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:26.105430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-944da8db-589b-4546-a718-5f5cc7d5206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:26.213073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 540/1082] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:35:26.500287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:26.501852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:26.522585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:26.673492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a26092-b1db-49cf-a6a0-bb15e1706369 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:26.780254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:26.806213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:26.806916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:26.807259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:26.807594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:26.809223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:26.906187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:26.907870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724f792-bf2f-4a2f-8238-fc2cf9379f03 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:26.930447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 543/1083] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:29.145291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:29.145906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:29.146024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:29.147581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 541/1084] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:29.152630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5bb8-d25c-41fb-99b4-a1bd52b2f415 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:29.153073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5bb8-d25c-41fb-99b4-a1bd52b2f415 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:29.153203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b5bb8-d25c-41fb-99b4-a1bd52b2f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:29.224807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9d9b5bb8-d25c-41fb-99b4-a1bd52b2f415 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:29.226513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d9b5bb8-d25c-41fb-99b4-a1bd52b2f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:29.288210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:29.340029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 544/1085] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:29.626674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:29.628192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:29.677290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:29.795866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3ebe-1d6f-485d-8d30-95f1381d02c5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:29.920123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:29.920827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:29.921193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:29.921465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:29.923043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:29.925311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:30.024147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:30.026275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600fdd2-1108-4a7d-8032-e9dbf2b404a6 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:30.044638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 542/1086] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:39.337575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=19 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:40.042512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=44 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:43.228857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f330e-b9b0-4713-be19-9c7e603bc4b6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:43.229569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f330e-b9b0-4713-be19-9c7e603bc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:43.229679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f330e-b9b0-4713-be19-9c7e603bc4b6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:43.231642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 545/1087] 10.222.0.30 () {54 vars in 918 bytes} [Tue Oct 11 06:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:43.237780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7795-1b11-4f91-b57f-7d2151fb4974 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:43.238221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7795-1b11-4f91-b57f-7d2151fb4974 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:43.238324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7795-1b11-4f91-b57f-7d2151fb4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:43.320419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6ff7795-1b11-4f91-b57f-7d2151fb4974 None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:43.321688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6ff7795-1b11-4f91-b57f-7d2151fb4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:43.430773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 543/1088] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 11 06:35:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:43.446587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a97-7f70-49b9-9ca9-d1a5cbb034ff None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:43.446897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a97-7f70-49b9-9ca9-d1a5cbb034ff None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:43.447164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd97a97-7f70-49b9-9ca9-d1a5cbb034ff None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:43.448540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 546/1089] 10.222.0.30 () {54 vars in 918 bytes} [Tue Oct 11 06:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:43.454050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a5e3-8749-44b7-bab8-5cf367ae5591 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:43.454330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a5e3-8749-44b7-bab8-5cf367ae5591 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:43.454598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a5e3-8749-44b7-bab8-5cf367ae5591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:43.531013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:43.534287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fc88a5e3-8749-44b7-bab8-5cf367ae5591 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:43.536205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fc88a5e3-8749-44b7-bab8-5cf367ae5591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:43.661947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 544/1090] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 11 06:35:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:46.246240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:46.247151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:46.247151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:46.249257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:35:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:46.255699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2468-1331-478f-9aca-0f7fbf99579d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:46.256132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2468-1331-478f-9aca-0f7fbf99579d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:46.256229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b2468-1331-478f-9aca-0f7fbf99579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:46.325111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0d6b2468-1331-478f-9aca-0f7fbf99579d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:46.326322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0d6b2468-1331-478f-9aca-0f7fbf99579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:46.387100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:46.430111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:46.721790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:46.723513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:46.880199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b0b06-5ec3-47b1-8185-3a313d470874 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:46.958469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:46.999211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:46.999819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:47.000090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:47.000352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:47.001992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:47.102244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:47.103889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13257-61a3-4967-8e1f-639db0f0caea service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:47.123515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 548/1093] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:48.259248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:48.259856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:48.259856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:48.261184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:48.268466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cba38-66f2-4a2d-b930-160d58879b86 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:48.269302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cba38-66f2-4a2d-b930-160d58879b86 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:48.269485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cba38-66f2-4a2d-b930-160d58879b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:48.356840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ff6cba38-66f2-4a2d-b930-160d58879b86 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:48.358087 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff6cba38-66f2-4a2d-b930-160d58879b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:48.388061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:48.461310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:48.630105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:48.631683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:48.787806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a94029-a2cd-447e-977c-5237ec729cd7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:48.830490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:48.905980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:48.906590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:48.906864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:48.907131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:48.908733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:49.012002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:49.013629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb45e-33d4-4f72-a275-03c6a34a5a6c service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:49.032006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 547/1096] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:50.154581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:50.155192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:50.155192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:50.157134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:50.165561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819615-4fab-431d-a950-72dae64fa83a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:50.165996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819615-4fab-431d-a950-72dae64fa83a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:50.166119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819615-4fab-431d-a950-72dae64fa83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:50.221276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:50.243594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bb819615-4fab-431d-a950-72dae64fa83a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:50.244811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb819615-4fab-431d-a950-72dae64fa83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:50.347617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:50.506828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:50.509201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:50.674109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f32ace-2fe8-40fe-872c-b3f25dd5112c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:50.688526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:50.794432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:50.794949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:50.795217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:50.795479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:50.797101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:50.888645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:50.890270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfd07b-0d3d-47a0-a368-998cab1927d8 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:50.908460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 551/1099] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:52.001428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:52.002006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:52.002006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:52.003396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:52.010798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246148-1798-48f9-9eb7-a87a13978834 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:52.011530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246148-1798-48f9-9eb7-a87a13978834 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:52.011530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3246148-1798-48f9-9eb7-a87a13978834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:52.034928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:52.092435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d3246148-1798-48f9-9eb7-a87a13978834 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:52.093651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3246148-1798-48f9-9eb7-a87a13978834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:52.196765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:52.350646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:52.352862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:52.486216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:52.526898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a124f-7356-4df4-b4b7-56578be8568f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:52.652290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:52.652916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:52.653219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:52.653481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:52.655079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:52.733368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:52.750038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:52.751630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e62573-d14c-4a2f-bf4e-3c23c77ce439 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:52.770604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 550/1102] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:53.883688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:53.884273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:53.884273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:53.886036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:53.892409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d36-2abf-4f06-916c-dfcdcd9520c7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:53.892910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d36-2abf-4f06-916c-dfcdcd9520c7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:53.892910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d36-2abf-4f06-916c-dfcdcd9520c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:53.971753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eff17d36-2abf-4f06-916c-dfcdcd9520c7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:53.973039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eff17d36-2abf-4f06-916c-dfcdcd9520c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:54.076353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:54.230780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:54.233178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:54.324218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:54.388075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea78314-2662-48ba-8623-ef5219e1b80f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:54.512812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:54.513379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:54.513653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:54.513920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:54.515550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:54.571605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:54.615511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:54.617185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564b174-addc-4344-a42e-4e54ca867458 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:54.635982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 554/1105] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:55.681220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:55.681766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:55.681861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:55.683181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:55.689917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855fe5-a353-496d-a639-15f326fbbef6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:55.690341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855fe5-a353-496d-a639-15f326fbbef6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:55.690438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855fe5-a353-496d-a639-15f326fbbef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:55.768489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-92855fe5-a353-496d-a639-15f326fbbef6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:55.769730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-92855fe5-a353-496d-a639-15f326fbbef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:55.873665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:56.024185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:56.025744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:56.082228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:56.183985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ee2a9-ef61-4e74-a91f-aa32798ec15a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:56.303658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:56.304294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:56.304567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:56.304833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:56.306512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:56.313654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:56.400353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:56.401978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcd17e-50e2-4231-a02e-0b9e49d8c4ed service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:56.421235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 553/1108] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:57.485283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:57.485893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:57.485893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:57.487201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:35:57.494632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2591d9-4906-4dce-a819-27a6d7d36606 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:57.495083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2591d9-4906-4dce-a819-27a6d7d36606 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:57.495205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2591d9-4906-4dce-a819-27a6d7d36606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:57.583465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8f2591d9-4906-4dce-a819-27a6d7d36606 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:57.584672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f2591d9-4906-4dce-a819-27a6d7d36606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:57.655659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:57.687232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:57.835995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:57.837471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:57.857496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:57.992403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eb341-88f8-4278-ab85-59cc3b403540 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:58.083478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:58.113704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:58.114301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:58.114542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:58.114867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:58.116457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:58.209124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:35:58.210748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37ade-99d3-4282-ad5f-8976278cf8b2 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:35:58.229399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 557/1111] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:35:59.274541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:59.275122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:59.275122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:59.276417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:35:59.283719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db9ac-4b08-479d-b779-5a1ff2f91ba1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:59.284428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db9ac-4b08-479d-b779-5a1ff2f91ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:59.284607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db9ac-4b08-479d-b779-5a1ff2f91ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:59.364541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-165db9ac-4b08-479d-b779-5a1ff2f91ba1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:35:59.365789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-165db9ac-4b08-479d-b779-5a1ff2f91ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:59.409303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:59.466915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:35:59.618070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:35:59.620371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:35:59.778039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d6d0-9b42-4a15-8c8d-2a9ea5f800c3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:35:59.834257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:35:59.894242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:35:59.894846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:35:59.895116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:35:59.895377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:35:59.896961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:00.000012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:00.001615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bfb91-7fd9-48c7-b901-48799cd496fd service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:00.020168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 556/1114] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:01.071697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:01.072576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:01.072576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:01.075045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:36:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:01.084659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3f48-6120-4efb-b223-14500cf731d3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:01.085127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3f48-6120-4efb-b223-14500cf731d3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:01.085225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3f48-6120-4efb-b223-14500cf731d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:01.175518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8a9a3f48-6120-4efb-b223-14500cf731d3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:01.176842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8a9a3f48-6120-4efb-b223-14500cf731d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:01.179037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:01.286810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:01.436839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:01.439416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:01.601723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958cae-79ff-495a-8cdc-e4bc719e9db0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:01.630950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:01.722189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:01.722712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:01.722976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:01.723235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:01.724874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:01.816772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:01.818410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b860-f890-4bd8-aa05-99d2d785445e service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:01.837612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 560/1117] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:03.892346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:03.893057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:03.893057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:03.894281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:03.900911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c491f-f3aa-4b42-9c5d-d6d373193349 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:03.901770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c491f-f3aa-4b42-9c5d-d6d373193349 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:03.901770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c491f-f3aa-4b42-9c5d-d6d373193349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:03.952899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:03.978736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a58c491f-f3aa-4b42-9c5d-d6d373193349 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:03.979953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a58c491f-f3aa-4b42-9c5d-d6d373193349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:04.083722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:04.370551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:04.372493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:04.483517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde9976-cdb5-49fd-bb46-910405bb364c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:04.517535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:04.560023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:04.560636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:04.560914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:04.561173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:04.562832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:04.677629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:04.679070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee976b5-ecc3-4546-ba40-e7d10940ce54 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:04.698010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 559/1120] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:07.006781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:07.007363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:07.007363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:07.008583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:07.015069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814552-1a00-43b4-a0da-63f17dee0cbb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:07.015795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814552-1a00-43b4-a0da-63f17dee0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:07.015999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814552-1a00-43b4-a0da-63f17dee0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:07.085689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-af814552-1a00-43b4-a0da-63f17dee0cbb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:07.086884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af814552-1a00-43b4-a0da-63f17dee0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:07.100873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:07.191332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:07.486643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:07.489067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:07.603707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e07e3a-b163-4e37-bb3d-eb126ba5123b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:07.618111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:07.690250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:07.690849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:07.691124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:07.691388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:07.692992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:07.806160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:07.807517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ac988-eb74-413f-b85a-bf9078e36cbc service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:07.826719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 563/1123] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:10.302398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:10.303318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:10.303318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:10.305462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:10.311826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e706-ad9a-4d02-820b-f08a4eef2517 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:10.312299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e706-ad9a-4d02-820b-f08a4eef2517 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:10.312404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e706-ad9a-4d02-820b-f08a4eef2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:10.368061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:10.389279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cb92e706-ad9a-4d02-820b-f08a4eef2517 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:10.390499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb92e706-ad9a-4d02-820b-f08a4eef2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:10.496431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:10.782781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:10.785409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:10.910792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14587102-cefe-4df6-87ed-d3c73047caf1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:10.961022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:10.997873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:10.998478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:10.998748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:10.999018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:11.000613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:11.124388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:11.125851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b61d-a61b-4c3c-9bc3-7aeef0ba014d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:11.144728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 562/1126] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:13.503131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:13.503753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:13.503753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:13.505110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:13.510682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23d4f-2e09-404f-9fb3-03d05eda1664 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:13.511132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23d4f-2e09-404f-9fb3-03d05eda1664 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:13.511241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b23d4f-2e09-404f-9fb3-03d05eda1664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:13.581633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b8b23d4f-2e09-404f-9fb3-03d05eda1664 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:13.582940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b8b23d4f-2e09-404f-9fb3-03d05eda1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:13.615694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:13.700877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:36:13.978931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:13.980491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:14.087866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280436b-9874-4a03-844e-097a1cccd918 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:14.110530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:14.166227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:14.166830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:14.167100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:14.167365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:14.168947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:14.284070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:14.285436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80d023-1e5d-43c5-86d1-2d96d89ec430 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:14.303533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 566/1129] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:36:16.509044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:16.509902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:16.509902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:16.512099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:16.521264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac287-9b9a-4964-9a09-10189774e1d7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:16.521693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac287-9b9a-4964-9a09-10189774e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:16.521804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fac287-9b9a-4964-9a09-10189774e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:16.595329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:16.598728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d7fac287-9b9a-4964-9a09-10189774e1d7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:16.600767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7fac287-9b9a-4964-9a09-10189774e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:16.711393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:17.006260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:17.008637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:17.126790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd00af-5d15-421d-b560-9c9aa49da62e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:17.177329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:17.202031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:17.202628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:17.202898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:17.203157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:17.204738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:17.323431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:17.325275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18749dbc-b22e-4a21-81a7-5b587af2aa18 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:17.345497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 565/1132] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:19.527272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:19.527858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:19.527858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:19.529219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:19.535912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f9e1-7ecd-4326-b9e6-eadde6757007 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:19.536380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f9e1-7ecd-4326-b9e6-eadde6757007 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:19.536483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f9e1-7ecd-4326-b9e6-eadde6757007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:19.605410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e3d2f9e1-7ecd-4326-b9e6-eadde6757007 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:19.606625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e3d2f9e1-7ecd-4326-b9e6-eadde6757007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:19.637721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:19.710341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:20.001621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:20.004113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:20.114193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02d916-3266-4160-b0aa-c0b71bad35ed None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:20.143586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:20.191518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:20.192163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:20.192437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:20.192704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:20.194338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:20.308448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:20.309822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169b32e-dd24-44f6-b71d-8bf269bb7151 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:20.328676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 569/1135] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:22.511106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:22.511757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:22.511757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:22.513039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:22.519626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d925-c9bc-4db6-bf97-12d6bb080c3c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:22.520373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d925-c9bc-4db6-bf97-12d6bb080c3c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:22.520527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d925-c9bc-4db6-bf97-12d6bb080c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:22.595403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8c95d925-c9bc-4db6-bf97-12d6bb080c3c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:22.596675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8c95d925-c9bc-4db6-bf97-12d6bb080c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:22.606315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:22.699145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:22.984649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:22.986262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:23.094076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa968ea-6bc8-4d71-b9ec-472cf1debb51 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:23.150206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:23.170124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:23.170739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:23.171012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:23.171277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:23.172869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:23.287306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:23.288655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eb673-4303-4fdb-83f1-52c041e74164 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:23.307251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 568/1138] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:36:25.514286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19519f-4175-4417-b583-fda9f504939a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:25.514889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19519f-4175-4417-b583-fda9f504939a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:25.514889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19519f-4175-4417-b583-fda9f504939a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:25.516174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:25.522785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f071-4805-4dea-8c8d-9367431932d3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:25.523495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f071-4805-4dea-8c8d-9367431932d3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:25.523680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f071-4805-4dea-8c8d-9367431932d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:25.597985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-66f1f071-4805-4dea-8c8d-9367431932d3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:25.599226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-66f1f071-4805-4dea-8c8d-9367431932d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:25.639603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:25.705721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:25.989358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19519f-4175-4417-b583-fda9f504939a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:25.991828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df19519f-4175-4417-b583-fda9f504939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:26.105407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19519f-4175-4417-b583-fda9f504939a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:26.144097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:26.182530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:26.183147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:26.183415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:26.183681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:26.185291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:26.306785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:26.308148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc85b-0bf9-44db-b382-dc4a8467e581 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:26.326851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 572/1141] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:28.508783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:28.509781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:28.509781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:28.511877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:28.517438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb991f3-7713-4d79-8197-5c26e461370c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:28.517914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb991f3-7713-4d79-8197-5c26e461370c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:28.518030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb991f3-7713-4d79-8197-5c26e461370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:28.591111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0eb991f3-7713-4d79-8197-5c26e461370c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:28.592315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0eb991f3-7713-4d79-8197-5c26e461370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:28.609652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:28.693350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:36:28.985455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:28.987004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:29.097605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9fa2e-5aff-45d7-857f-cba91d8d8728 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:29.168212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:29.175198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:29.175799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:29.176078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:29.176368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:29.177991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:29.288604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:29.289977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c7729-b3f9-4e66-8034-27fecb6e886c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:29.313011 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 571/1144] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:36:31.463767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:31.464337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:31.464337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:31.466624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:36:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:31.475633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92ced-a75e-49c1-aaeb-0503551374b2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:31.476059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92ced-a75e-49c1-aaeb-0503551374b2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:31.476192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92ced-a75e-49c1-aaeb-0503551374b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:31.551656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7bd92ced-a75e-49c1-aaeb-0503551374b2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:31.552857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7bd92ced-a75e-49c1-aaeb-0503551374b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:31.606767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:31.657238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:31.936904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:31.939420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:32.052709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec536e24-e4c1-4b2d-9561-fba486be61af None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:32.112896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:32.139858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:32.140465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:32.140734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:32.141017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:32.142630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:32.264349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:32.265751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ede5e-584a-49f2-947e-8e3c7bbed6fa service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:32.284930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 575/1147] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:41.655663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=22 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:42.282503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=66 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:52.074306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c0fa-46a5-41bc-a63f-67894d834039 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:52.075592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c0fa-46a5-41bc-a63f-67894d834039 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:52.075592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c0fa-46a5-41bc-a63f-67894d834039 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:52.077688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 573/1148] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:52.085428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbf1c-a82a-4156-b8a2-def049482d41 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:52.085932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbf1c-a82a-4156-b8a2-def049482d41 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:52.085932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbf1c-a82a-4156-b8a2-def049482d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:52.161455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6f0cbf1c-a82a-4156-b8a2-def049482d41 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:52.162659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6f0cbf1c-a82a-4156-b8a2-def049482d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:52.262861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 576/1149] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:36:52.558141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:52.558445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:52.558696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:52.560038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 574/1150] 10.222.0.30 () {54 vars in 962 bytes} [Tue Oct 11 06:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:52.565614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb751-5c13-46ed-b253-92c67b5e68ac None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:52.565955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb751-5c13-46ed-b253-92c67b5e68ac None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:52.566232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb751-5c13-46ed-b253-92c67b5e68ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:52.643624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-676bb751-5c13-46ed-b253-92c67b5e68ac None None] MFA Rules not processed for user `70f7e360a0824d328c393df1eacbc06e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:52.644845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-676bb751-5c13-46ed-b253-92c67b5e68ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:52.666935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:52.726975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 577/1151] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Oct 11 06:36:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:52.735485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:52.737917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:52.848812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3299da2-e2a8-4c49-8a29-d235e2a0f1a5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:52.928063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:52.928579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:52.928853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:52.929150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:52.930768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:52.986364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:53.043838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:53.045305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72c936-02f3-4c7c-923a-53d73b60138b service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:53.063851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 575/1152] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:36:55.299477 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:55.300098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:55.300098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:55.301425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 578/1153] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:55.307798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c034f-525a-4323-bbc6-7932ddeceaa8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:55.308544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c034f-525a-4323-bbc6-7932ddeceaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:55.308688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c034f-525a-4323-bbc6-7932ddeceaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:55.382267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-959c034f-525a-4323-bbc6-7932ddeceaa8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:55.383475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-959c034f-525a-4323-bbc6-7932ddeceaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:55.485686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 576/1154] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:55.754388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:55.755937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:55.886168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a28e-fbc6-4e63-afac-6c9c0460b985 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:55.937905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:55.990399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:55.991164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:55.991711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:55.992072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:55.993078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:55.994407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:36:55.994407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:36:55.994407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:36:55.996034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff1a9-aae8-4799-bc48-869ef1727280 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:56.019592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 579/1155] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 11 06:36:55 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:36:58.186635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:58.187273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:58.187273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:58.188512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 577/1156] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:36:58.194212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0102-30ed-4e84-8b06-e90ff7fa6e5d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:58.194675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0102-30ed-4e84-8b06-e90ff7fa6e5d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:58.194779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a0102-30ed-4e84-8b06-e90ff7fa6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:58.265646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-368a0102-30ed-4e84-8b06-e90ff7fa6e5d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:36:58.266838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-368a0102-30ed-4e84-8b06-e90ff7fa6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:58.374625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 580/1157] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:36:58.672193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:36:58.673896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:58.683997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:58.828226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13237e-b984-4b48-bfcd-475cb4892d73 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:36:58.910853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:36:58.948427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:36:58.949027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:36:58.949338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:36:58.949971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:36:58.951570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:36:59.046455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:36:59.048062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a1c90-09a8-4281-8ee3-938e67a8dfa9 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:36:59.066098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 578/1158] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:37:01.404155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:01.404766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:01.404766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:01.406084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 581/1159] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:37:01.412936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e903e6f-995b-4236-93f6-3dfa595c8aee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:01.413672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e903e6f-995b-4236-93f6-3dfa595c8aee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:01.413819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e903e6f-995b-4236-93f6-3dfa595c8aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:01.494699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4e903e6f-995b-4236-93f6-3dfa595c8aee None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:37:01.495931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e903e6f-995b-4236-93f6-3dfa595c8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:01.544473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:01.599305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 579/1160] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:37:01.885447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:37:01.887935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:01.916179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:01.997650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8748d-54e9-4914-b1e8-b2a7631559c0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:37:02.078636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:37:02.079259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:02.079537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:02.079808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:02.081457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:02.159413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:02.196639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:37:02.198123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e158d41-ad80-4b26-9e5d-0f6739fc0ada service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:37:02.217035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 582/1161] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:37:04.415204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:04.415677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:04.415773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:04.417123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 580/1162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:37:04.423462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbfe4-6281-4701-b9bd-d1baba3d9904 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:04.424212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbfe4-6281-4701-b9bd-d1baba3d9904 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:04.424375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfbfe4-6281-4701-b9bd-d1baba3d9904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:04.498786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-77dfbfe4-6281-4701-b9bd-d1baba3d9904 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:37:04.500002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-77dfbfe4-6281-4701-b9bd-d1baba3d9904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:04.601220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 583/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:37:04.887412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:37:04.889943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:05.007578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b75ab-e360-444d-acd2-f42d7af66fc4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:37:05.090498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:05.091970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:37:05.092615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:05.092912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:05.093227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:05.095357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:05.214126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:37:05.215473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8570e-32cb-4026-bde8-7787cf7d2087 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:37:05.233938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 581/1164] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:37:07.513392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:07.514328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:07.514328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:07.516376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 584/1165] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:37:07.525428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d146e-1f39-40ad-a0ca-0ec210d07597 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:07.525863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d146e-1f39-40ad-a0ca-0ec210d07597 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:07.525994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d146e-1f39-40ad-a0ca-0ec210d07597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:07.601712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-165d146e-1f39-40ad-a0ca-0ec210d07597 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:37:07.602931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-165d146e-1f39-40ad-a0ca-0ec210d07597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:07.659228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:07.705965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 582/1166] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:37:07.995312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:37:07.997836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:08.042081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:08.111732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d001d-e07a-42f3-a132-e3d76f78480b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:37:08.188866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:37:08.189523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:08.189794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:08.190057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:08.191656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:08.284287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:08.313507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:37:08.314957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1fbfb-a673-4d3a-b9c1-b04b14348a85 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:37:08.333986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 585/1167] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:37:10.770545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:10.771113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:10.771113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:10.772367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 583/1168] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 11 06:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:37:10.781387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93a38-617d-4f88-948b-f2cd2906b060 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:10.781846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93a38-617d-4f88-948b-f2cd2906b060 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:10.781982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f93a38-617d-4f88-948b-f2cd2906b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:10.862711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f4f93a38-617d-4f88-948b-f2cd2906b060 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:37:10.864241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4f93a38-617d-4f88-948b-f2cd2906b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:10.978478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 586/1169] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 11 06:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:37:11.262703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:37:11.264272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:11.374210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676ce3-cca6-4c11-87a5-650b5b6c3215 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:37:11.458286 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:37:11.458899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:37:11.459176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:37:11.459442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:37:11.461079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:37:11.470395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:11.576847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:37:11.578559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a640-c85b-4a9d-8da8-7fd52c2dfbb5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:37:11.597339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 584/1170] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:37:20.976619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:37:21.595140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=50 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:24.264533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:24.265509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:24.265509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:24.349601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:38:24.350758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:24.454194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 587/1171] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:38:24.462124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:24.462624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:24.462624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:24.541939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:38:24.543167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:24.648111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 585/1172] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:38:24.653061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:24.654325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:24.666600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ba02f-ac4c-4cf0-85bb-2abd0369d7ec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:24.742375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:24.777189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:24.777797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:24.778075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:24.778338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:24.778975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:38:24.779269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:24.780309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:38:24.780309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:38:24.780309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:38:24.781202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:24.793520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 588/1173] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:38:24.803531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:24.813087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f01f7-2e5c-463a-bc0a-d91da60d7ebc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:24.879544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:24.913919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:24.914446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:24.914703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:24.914984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:24.915621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:24.916731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:38:24.916731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:38:24.916731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:38:24.917938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:24.979197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 586/1174] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:38:24 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:38:24.980309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:24.981876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:25.016245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf5f7-dfb3-4a71-8e39-dd83bdc76d3f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:25.123566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:25.124174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.124448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.124715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.125388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:25.126410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:38:25.126410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:38:25.126410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:38:25.127612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:25.173718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 589/1175] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:38:24 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:38:25.178022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:25.179584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:25.242088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535dbc-ebd6-443b-b1d4-747363d7bf44 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:25.330905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:25.342769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:25.343399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.343670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.343926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.344568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:25.346200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:25.359613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 587/1176] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:38:25.363999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:25.365630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:25.377636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d771-fd48-4f88-a013-2bc558c5aeb1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:25.403209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:25.476037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:25.476556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.476833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.477125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.477779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:25.479380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32404756-86e8-419e-a09e-a4cfb5f79985 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:25.491678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 590/1177] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:38:25.496054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:25.497621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:25.532381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec338-8f40-486c-99fb-5ded81b98e5c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:25.630911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:25.631593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.631863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.632124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] PATH_INFO: `/v3/projects/c9bef16dbea447cbae3bbe6c0e7df403/users/2df47b30bae74103b9d56460866dc796/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.656915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bef16dbea447cbae3bbe6c0e7df403, user_id=2df47b30bae74103b9d56460866dc796, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:25.659623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc80eb-ae70-44ac-8e87-11ee6fd41226 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:25.686573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 588/1178] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:38:25 2022] PUT /identity/v3/projects/c9bef16dbea447cbae3bbe6c0e7df403/users/2df47b30bae74103b9d56460866dc796/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:38:25.698359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996f56-ba65-4114-bd76-5f03349ee09b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.698648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996f56-ba65-4114-bd76-5f03349ee09b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.698918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996f56-ba65-4114-bd76-5f03349ee09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.759790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c4996f56-ba65-4114-bd76-5f03349ee09b None None] MFA Rules not processed for user `2df47b30bae74103b9d56460866dc796`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:38:25.760911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c4996f56-ba65-4114-bd76-5f03349ee09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:25.843004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 591/1179] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:38:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:38:25.858472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.858753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.859020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.860366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 589/1180] 10.222.0.30 () {54 vars in 963 bytes} [Tue Oct 11 06:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:38:25.865495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5411d87-2487-41d4-a8fe-789043afb65f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:25.865783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5411d87-2487-41d4-a8fe-789043afb65f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:25.866053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5411d87-2487-41d4-a8fe-789043afb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:25.900079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:25.950442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d5411d87-2487-41d4-a8fe-789043afb65f None None] MFA Rules not processed for user `d21a5a40ab384688bb267a44a749f085`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:38:25.952010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d5411d87-2487-41d4-a8fe-789043afb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:26.033694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 592/1181] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Oct 11 06:38:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:38:26.042995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:26.044554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:26.098511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:26.153486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed57c8-2099-4b5b-a1a9-96cffe58c7d6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:26.243019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:26.243714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:26.244185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:26.244515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:26.246156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:26.353497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:26.354857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:26.358490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:26.374846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 590/1182] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:38:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:38:26.421294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff8d6-7264-4cea-aa0e-05065abfd4b0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:26.421762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff8d6-7264-4cea-aa0e-05065abfd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:26.421868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ff8d6-7264-4cea-aa0e-05065abfd4b0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:26.423123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 593/1183] 10.222.0.30 () {52 vars in 830 bytes} [Tue Oct 11 06:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:38:26.428249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:26.429509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:26.535487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092ad7-d745-4e95-8ef4-e5c7d02ea68c service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:26.633755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:26.634389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:26.634665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:26.634932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] PATH_INFO: `/v3/users/2df47b30bae74103b9d56460866dc796` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:26.648181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df47b30bae74103b9d56460866dc796)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:26.649238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:38:26.649238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:38:26.649238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:38:26.650460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:26.660734 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:26.720091 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df47b30bae74103b9d56460866dc796'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:26.731418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df47b30bae74103b9d56460866dc796'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:26.754495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df47b30bae74103b9d56460866dc796'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:26.754937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df47b30bae74103b9d56460866dc796'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:26.768796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df47b30bae74103b9d56460866dc796'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:26.775031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 591/1184] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:38:26 2022] DELETE /identity/v3/users/2df47b30bae74103b9d56460866dc796 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:38:26.779689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:26.780069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:26.780347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:26.839441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:38:26.840637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:26.915817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:26.928419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 594/1185] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:38:26.940190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:26.941474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:27.052219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17009d97-24cc-4f26-b8a2-a59222abb8d7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:27.110235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:27.134262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:27.134879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:27.135155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:27.135427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:27.137068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:27.259642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:27.261035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841c4f-4c8b-4e34-99a1-79a5ae2baf35 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:27.279993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 592/1186] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:38:27.640822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:38:27.642141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:38:27.653979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aaba5-25b1-4c31-afaf-ad5774c23623 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:38:27.752883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:38:27.753561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:38:27.753830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:38:27.754085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] PATH_INFO: `/v3/projects/c9bef16dbea447cbae3bbe6c0e7df403` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:38:27.768120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bef16dbea447cbae3bbe6c0e7df403)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:38:27.769640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:38:27.769640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:38:27.769640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:38:27.771316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:38:27.830571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bef16dbea447cbae3bbe6c0e7df403', 'request_id': 'req-acb9a36b-a560-409f-aeb1-b7965650f8d3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:27.841942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bef16dbea447cbae3bbe6c0e7df403', 'request_id': 'req-acb9a36b-a560-409f-aeb1-b7965650f8d3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:27.848024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bef16dbea447cbae3bbe6c0e7df403', 'request_id': 'req-acb9a36b-a560-409f-aeb1-b7965650f8d3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:27.878406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] The token cache is being invalidate because project c9bef16dbea447cbae3bbe6c0e7df403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:38:27.878689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:27.879204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-acb9a36b-a560-409f-aeb1-b7965650f8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:38:27.880523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 595/1187] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:38:27 2022] DELETE /identity/v3/projects/c9bef16dbea447cbae3bbe6c0e7df403 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:38:37.277601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=62 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:38:37.876037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:57.646143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:57.647070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:57.647070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:57.649211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 593/1188] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:39:57.657467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3897ae-7ec9-4e62-9218-74affab0f55d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:57.658220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3897ae-7ec9-4e62-9218-74affab0f55d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:57.658370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3897ae-7ec9-4e62-9218-74affab0f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:57.751623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4b3897ae-7ec9-4e62-9218-74affab0f55d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:39:57.752834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b3897ae-7ec9-4e62-9218-74affab0f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:39:57.862890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 596/1189] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:39:58.019354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:39:58.021704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:39:58.149401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e18847-a886-46d0-bcb3-7d0c99936c02 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:39:58.155344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:39:58.155970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:58.156259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:58.156493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:58.165700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:39:58.167335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b97d0-d657-4076-bf60-e9e9ed9ef0d1 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:39:58.178274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 594/1190] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:39:59.263728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7a1c-e06e-48eb-af00-d94a822b241e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:59.264314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7a1c-e06e-48eb-af00-d94a822b241e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:59.264314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7a1c-e06e-48eb-af00-d94a822b241e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:59.265672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 597/1191] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:39:59.272028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36d63-47bf-4c6b-a880-ee296370957b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:59.272481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36d63-47bf-4c6b-a880-ee296370957b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:59.272591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d36d63-47bf-4c6b-a880-ee296370957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:59.292771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-29d36d63-47bf-4c6b-a880-ee296370957b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:39:59.294012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-29d36d63-47bf-4c6b-a880-ee296370957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:39:59.303438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 595/1192] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:39:59.456159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc7a1c-e06e-48eb-af00-d94a822b241e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:39:59.474371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc7a1c-e06e-48eb-af00-d94a822b241e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:39:59.481175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:39:59.481773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:59.482048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:59.482316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:59.490961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:39:59.492549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f3479-b75c-438f-9480-cf0a8156c8dc service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:39:59.502023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 598/1193] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:39:59.687987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25f09-372e-4a87-8a1b-fd1326b900c1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:59.688269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25f09-372e-4a87-8a1b-fd1326b900c1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:59.688528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b25f09-372e-4a87-8a1b-fd1326b900c1 None None] PATH_INFO: `/v3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:59.689891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 596/1194] 10.222.0.20 () {54 vars in 925 bytes} [Tue Oct 11 06:39:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:39:59.697239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4454-44cb-428a-b2fb-83207e21d5eb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:39:59.697525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4454-44cb-428a-b2fb-83207e21d5eb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:39:59.697792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4454-44cb-428a-b2fb-83207e21d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:39:59.761313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f78a4454-44cb-428a-b2fb-83207e21d5eb None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:39:59.762540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f78a4454-44cb-428a-b2fb-83207e21d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:39:59.780525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:39:59.849912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 599/1195] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Oct 11 06:39:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:08.822945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31507a-54d2-4be7-aa5d-9027e7bc16ca None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:08.823433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31507a-54d2-4be7-aa5d-9027e7bc16ca None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:08.823540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31507a-54d2-4be7-aa5d-9027e7bc16ca None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:08.824886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 597/1196] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:08.830341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fbdf-a3bc-49e1-8f80-6032a4f8c79a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:08.830836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fbdf-a3bc-49e1-8f80-6032a4f8c79a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:08.830936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fbdf-a3bc-49e1-8f80-6032a4f8c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:08.851395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1c66fbdf-a3bc-49e1-8f80-6032a4f8c79a None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:08.852684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1c66fbdf-a3bc-49e1-8f80-6032a4f8c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:08.862999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 600/1197] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:40:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:08.871283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31507a-54d2-4be7-aa5d-9027e7bc16ca None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:08.886701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31507a-54d2-4be7-aa5d-9027e7bc16ca None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:08.892915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:08.893536 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:08.893806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:08.894090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:08.903032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:08.904630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ea8c5-742e-40c0-a9b0-f7f795f88b23 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:08.914670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 598/1198] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:11.010986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6512c-6a53-435c-97a1-48294eec7ced None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:11.011641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6512c-6a53-435c-97a1-48294eec7ced None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:11.011641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6512c-6a53-435c-97a1-48294eec7ced None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:11.012900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 601/1199] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:11.019293 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f7c8-eff1-4b06-bdd4-38867226afae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:11.019791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f7c8-eff1-4b06-bdd4-38867226afae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:11.019791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34f7c8-eff1-4b06-bdd4-38867226afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:11.046820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ee34f7c8-eff1-4b06-bdd4-38867226afae None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:11.048029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee34f7c8-eff1-4b06-bdd4-38867226afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:11.057439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 599/1200] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:11.214316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6512c-6a53-435c-97a1-48294eec7ced None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:11.233501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6512c-6a53-435c-97a1-48294eec7ced None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:11.239482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:11.240073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:11.240338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:11.240585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:11.248740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:11.250347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72702be3-7b38-4338-b34c-495c56fd7309 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:11.260209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 602/1201] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:12.314923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9493e9-847d-4028-8faf-55abb6ba7615 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:12.315545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9493e9-847d-4028-8faf-55abb6ba7615 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:12.315545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9493e9-847d-4028-8faf-55abb6ba7615 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:12.316840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 600/1202] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 06:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:12.323210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea4fe-cce7-47d3-8c0e-b20c66f22ffa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:12.323696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea4fe-cce7-47d3-8c0e-b20c66f22ffa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:12.323793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baea4fe-cce7-47d3-8c0e-b20c66f22ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:12.343596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5baea4fe-cce7-47d3-8c0e-b20c66f22ffa None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:12.344807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5baea4fe-cce7-47d3-8c0e-b20c66f22ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:12.352992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 603/1203] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:12.506630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9493e9-847d-4028-8faf-55abb6ba7615 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:12.524723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9493e9-847d-4028-8faf-55abb6ba7615 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:12.530741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:12.531380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:12.531652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:12.531918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:12.540203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:12.541967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb248b-516f-4fab-80bf-919d425dfd40 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:12.551834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 601/1204] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:16.459659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:16.460256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:16.460256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:16.462518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 604/1205] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:40:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:16.468818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdaacc-a360-4c29-8b90-3d4d426de843 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:16.469351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdaacc-a360-4c29-8b90-3d4d426de843 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:16.469351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdaacc-a360-4c29-8b90-3d4d426de843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:16.489645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b6bdaacc-a360-4c29-8b90-3d4d426de843 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:16.490824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b6bdaacc-a360-4c29-8b90-3d4d426de843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:16.499680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 602/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:40:16.794054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:16.797114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:16.887180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a3f8b-b199-4c6f-882e-38e3670a81c5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:16.891433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:16.892036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:16.892310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:16.892574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:16.902307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:16.903783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777e47-6c4f-4fef-a590-fa690e452148 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:16.913377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 605/1207] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:19.082321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52eb0-d439-4a94-8b11-7d823672ac46 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:19.082931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52eb0-d439-4a94-8b11-7d823672ac46 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:19.082931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a52eb0-d439-4a94-8b11-7d823672ac46 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:19.084201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 603/1208] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:19.090714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cf35-eb6d-480b-8d5a-e22b6ac6b66d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:19.091513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cf35-eb6d-480b-8d5a-e22b6ac6b66d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:19.091697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cf35-eb6d-480b-8d5a-e22b6ac6b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:19.118198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7636cf35-eb6d-480b-8d5a-e22b6ac6b66d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:19.119406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7636cf35-eb6d-480b-8d5a-e22b6ac6b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:19.128612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 606/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:19.415457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52eb0-d439-4a94-8b11-7d823672ac46 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:19.435013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a52eb0-d439-4a94-8b11-7d823672ac46 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:19.440744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:19.441560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:19.441932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:19.442263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:19.455763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:19.457463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb330-979e-46f0-837a-356fc2db914f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:19.468030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 604/1210] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:23.091713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:23.092301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:23.092426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:23.093784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 607/1211] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:23.103025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01ee0-d91d-4bf7-a7ab-3f543ded326c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:23.103755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01ee0-d91d-4bf7-a7ab-3f543ded326c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:23.103937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b01ee0-d91d-4bf7-a7ab-3f543ded326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:23.131737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c2b01ee0-d91d-4bf7-a7ab-3f543ded326c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:23.132967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c2b01ee0-d91d-4bf7-a7ab-3f543ded326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:23.142473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 605/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:23.447112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:23.450352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:23.517997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:40:23.532841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6ea4e-bc83-46bd-911c-29361147f837 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:23.536844 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:23.537501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:23.537746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:23.538008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:23.547240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:23.548664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2a76c-951e-4175-9e82-fb751ff1b820 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:23.558377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 608/1213] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:25.676311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:25.676909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:25.676909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:25.678264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 606/1214] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 06:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:40:25.684540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6d1a-36d2-42aa-8d66-c1fbb43bd01a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:25.685339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6d1a-36d2-42aa-8d66-c1fbb43bd01a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:25.685492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6d1a-36d2-42aa-8d66-c1fbb43bd01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:25.714302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-403c6d1a-36d2-42aa-8d66-c1fbb43bd01a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:40:25.715674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-403c6d1a-36d2-42aa-8d66-c1fbb43bd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:25.725773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 609/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 06:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:40:26.032467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:40:26.035538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:40:26.052844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92dfc5-3341-4603-bf27-1d6100e93243 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:40:26.056929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:40:26.057557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:40:26.057831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:40:26.058093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:40:26.067878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:40:26.069384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378d06-7ae8-4ee4-922f-73993e97f44c service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:40:26.079920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 607/1216] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:40:35.708022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=11 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:40:36.074965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:56.294262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.295484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.295991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.324356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:56.326349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:56.338519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 610/1217] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:56.348525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.349853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.350009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.375343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:56.376688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:56.391444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 608/1218] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:56.396261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.409790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c274-58fd-484f-b09f-044d4921328b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.417878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.418776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.419280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.419765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.420642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:56.421183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.423083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.441054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 611/1219] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:56.448786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.462387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a4986-d9a3-465e-8628-90274d0b772a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.469873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.470496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.470770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.471039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.471680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.473628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.544021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 609/1220] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:56 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:56.550337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.579651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182c6da-7167-447c-b9d1-beb56e6902ec admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.705873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.706540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.706816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.707091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.707755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.709874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.750251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 612/1221] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:56 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:56.755359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.782649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a6b2-f5cd-4f44-a4c1-f69987277f12 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.793379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.794027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.794303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.794575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.795241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.796853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.814063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 610/1222] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:56.818083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.831824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329bdd1-fadf-4867-b233-4bfbe3385634 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.841546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.842165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.842442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.842715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.843372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.845171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaca37-db12-481a-9a25-0e0465be4aca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.863161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 613/1223] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:56.867069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:56.879405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292e681-cf6c-4094-a2a3-985bc1496761 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:56.889099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:56.889848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.890253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.890531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] PATH_INFO: `/v3/projects/dc10a50346f64d9fa97518f2019e3c75/users/4574fd9294294b30bf378b3769c6cc01/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.909050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc10a50346f64d9fa97518f2019e3c75, user_id=4574fd9294294b30bf378b3769c6cc01, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:56.911970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767b085-36cb-4c84-b75f-e84d1c63f1b4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:56.933520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 611/1224] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:56 2022] PUT /identity/v3/projects/dc10a50346f64d9fa97518f2019e3c75/users/4574fd9294294b30bf378b3769c6cc01/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:56.947577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a25922-07cc-46e0-a955-5b9abf46019d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:56.947778 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a25922-07cc-46e0-a955-5b9abf46019d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:56.948042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a25922-07cc-46e0-a955-5b9abf46019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:56.998536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a4a25922-07cc-46e0-a955-5b9abf46019d None None] MFA Rules not processed for user `4574fd9294294b30bf378b3769c6cc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:56.999794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a4a25922-07cc-46e0-a955-5b9abf46019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.062115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4faa-19cb-47a6-beb0-baba573d32a6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.062456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4faa-19cb-47a6-beb0-baba573d32a6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.062673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4faa-19cb-47a6-beb0-baba573d32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.103596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3f2b4faa-19cb-47a6-beb0-baba573d32a6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.104851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3f2b4faa-19cb-47a6-beb0-baba573d32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.118879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 614/1225] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.120605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa70d3-ed99-4717-8a30-caa9f214aae0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.121143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa70d3-ed99-4717-8a30-caa9f214aae0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.121634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa70d3-ed99-4717-8a30-caa9f214aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.177785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-85fa70d3-ed99-4717-8a30-caa9f214aae0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.179673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-85fa70d3-ed99-4717-8a30-caa9f214aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.230568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 612/1226] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 11 06:41:57.231763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7964-a9c1-42f5-87bc-1ed1173457c7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.232051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7964-a9c1-42f5-87bc-1ed1173457c7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.232322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc7964-a9c1-42f5-87bc-1ed1173457c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.245228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:57.257902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5bdc7964-a9c1-42f5-87bc-1ed1173457c7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.259125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5bdc7964-a9c1-42f5-87bc-1ed1173457c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.268487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 613/1227] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.270923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304946b0-909c-47e6-a4a1-06b3bdfd8990 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.270923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304946b0-909c-47e6-a4a1-06b3bdfd8990 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.270923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304946b0-909c-47e6-a4a1-06b3bdfd8990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.275540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 615/1228] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.277193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626503-b174-49af-9ad4-5c20e0ad86ef None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.280568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626503-b174-49af-9ad4-5c20e0ad86ef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.281137 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a626503-b174-49af-9ad4-5c20e0ad86ef None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.282873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 616/1229] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:41:57.284785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3bb3c-71f5-4157-ad64-d22bf56ef5bb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.285323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3bb3c-71f5-4157-ad64-d22bf56ef5bb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.285813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3bb3c-71f5-4157-ad64-d22bf56ef5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.296728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-304946b0-909c-47e6-a4a1-06b3bdfd8990 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.298070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-304946b0-909c-47e6-a4a1-06b3bdfd8990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.306131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 614/1230] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.309053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276fe7-f976-4ea8-96d0-a894d6832cb8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.309053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276fe7-f976-4ea8-96d0-a894d6832cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.309272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a3a3bb3c-71f5-4157-ad64-d22bf56ef5bb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.309821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d276fe7-f976-4ea8-96d0-a894d6832cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.309913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a3a3bb3c-71f5-4157-ad64-d22bf56ef5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.322411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 617/1231] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.323720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2a85-9308-458d-9933-71be3d478a39 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.324006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2a85-9308-458d-9933-71be3d478a39 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.324277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d2a85-9308-458d-9933-71be3d478a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.333030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6d276fe7-f976-4ea8-96d0-a894d6832cb8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.334822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6d276fe7-f976-4ea8-96d0-a894d6832cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.342582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 615/1232] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.343920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87291a8-827b-4b9e-9ba6-fe44c6ced6fa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.344202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87291a8-827b-4b9e-9ba6-fe44c6ced6fa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.344465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87291a8-827b-4b9e-9ba6-fe44c6ced6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.346235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ec4d2a85-9308-458d-9933-71be3d478a39 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.347447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec4d2a85-9308-458d-9933-71be3d478a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.355685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 618/1233] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.356864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.357179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.357444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.365681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a87291a8-827b-4b9e-9ba6-fe44c6ced6fa None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.366881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a87291a8-827b-4b9e-9ba6-fe44c6ced6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.375597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 616/1234] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.376800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278576-d1ea-4004-9d80-6c9874fc8014 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.377170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278576-d1ea-4004-9d80-6c9874fc8014 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.377445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55278576-d1ea-4004-9d80-6c9874fc8014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.395094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.396175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-55278576-d1ea-4004-9d80-6c9874fc8014 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.396303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.397389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-55278576-d1ea-4004-9d80-6c9874fc8014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.405318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 617/1235] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.406460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2fe33-2ec2-4714-929b-bff637874342 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.406738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2fe33-2ec2-4714-929b-bff637874342 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.407007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2fe33-2ec2-4714-929b-bff637874342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.426018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9ca2fe33-2ec2-4714-929b-bff637874342 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.427208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9ca2fe33-2ec2-4714-929b-bff637874342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.435132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 618/1236] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.436339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808076de-62ee-41a3-ab49-39a6a1640d37 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.436621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808076de-62ee-41a3-ab49-39a6a1640d37 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.436897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808076de-62ee-41a3-ab49-39a6a1640d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.456879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-808076de-62ee-41a3-ab49-39a6a1640d37 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.458088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-808076de-62ee-41a3-ab49-39a6a1640d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.466117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 619/1237] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.467265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.467542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.467806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.475682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 619/1238] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.476779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.487003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96747d8-741f-45bd-86fc-b6c93c39d869 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.487931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.489137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.491858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.492566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.492853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.493116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.493937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.494238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.495892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.497158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 620/1239] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.497911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.508260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 620/1240] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.509143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.516716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c93d80-613c-45b1-a474-5c373ba0dc15 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.518667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09406371-57d5-4b85-b62c-44e164df72b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.521544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.522196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.522473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.522743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.523277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.523391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.523688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.523851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.524125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.524390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.524713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:41:57.524713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:41:57.524713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:41:57.525037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.525336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.525639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834febe-f101-44a1-9935-5cd6736d84cc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.526896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.537630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 621/1241] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.538799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.544825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.544932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 621/1242] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.545051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.545145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.554987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331abfa7-17d7-423d-bd6d-db8518daf02e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.559727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.560349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.560608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.560878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.561542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.561837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.562096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.563298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.563423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.571519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 622/1243] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.572134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.578904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 622/1244] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.579739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.587235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976d4f-d347-4b61-8a92-c99bb6dbe23c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.592092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.592242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4e0a4-52ef-4caf-83b9-8910956d830f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.592804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.593116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.593509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.594170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.594473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.596118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed807f3-74ab-49ae-be02-d5778ee3dafd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.598590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.599200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.599480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.599818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.607801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.608411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 623/1245] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.609421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.609534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.609714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.609983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.618521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 623/1246] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:57.619276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.626161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:57.629448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124f88-2eb8-45cf-949d-250af84e5562 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.634277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.634867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.635141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.635474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.636096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.637240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:41:57.637240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:41:57.637240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:41:57.638524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.642896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:57.644129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:57.652717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 624/1247] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:57.653531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.664569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac62f5b-4ecb-4549-91f9-48b405971c1c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.669312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.669910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.673366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.673366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.673613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 624/1248] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:57.673712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.673801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.673887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.706008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 625/1249] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:57.706008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.721452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:57.747859 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5ea8-bf5f-4297-9d7a-e139828721ca admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.776183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc257b0f-c4d0-4dfb-8994-cd390a5af525 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.781720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.782442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.782790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.783122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.783827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.784196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.785901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.805613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 626/1250] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.805613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.809322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372614c-956d-4a90-bf4c-568f8a064fad admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.814411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.815020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.815300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.815573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.816426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.817971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.818397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.818618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.818885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.819272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.819903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.821804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.850040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 627/1251] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:57.851007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.855231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 625/1252] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:57.856526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.913071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30b50-0bec-49a7-93eb-f9fcdd7f9c91 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.917664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.918277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.918538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.918791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd80e6-cdb2-4d59-a6c3-4d16436e7628 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.918899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.919414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.921329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.923413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:57.924022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:57.924296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:57.924561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:57.925265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:41:57.925566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:57.927167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:57.938727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 626/1253] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:41:57.939815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.952966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 628/1254] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:57.953191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b268-f94a-4653-a361-4309a3a947b1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:57.953317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:57.985180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.007660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.008222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.008496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.008762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.009458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.011358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.014522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7ce6-9775-40f5-83a6-3c99ba4faf04 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.019335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.019921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.020197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.020465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.021200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.022094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.022405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:41:58.022405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:41:58.022405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:41:58.023733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.037266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 627/1255] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.038075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.048188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a265b-34e3-4bc9-9b62-e8bb3c3a75cb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.049298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 629/1256] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:57 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.050106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.053215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.053889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.054253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.054586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.055286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.057301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d9c6-84f6-4c9f-9d88-71374ec6d241 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.060185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbab31d-d2c6-4e24-9bdb-bc804153a110 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.064817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.065446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.065722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.065994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.066619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.068642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.086111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 628/1257] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.087464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dcf15-2489-4164-8187-215b423380fc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.087745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dcf15-2489-4164-8187-215b423380fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.088011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dcf15-2489-4164-8187-215b423380fc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.089414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 629/1258] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 11 06:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:41:58.090103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dcf15-2489-4164-8187-215b423380fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.095349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 630/1259] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.096471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.106204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074e5e2-5ece-4740-976c-a2630c9b24dd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.158476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dcf15-2489-4164-8187-215b423380fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.162560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.163185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.163337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.163464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.163719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.164170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.164425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.164524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.164691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.165345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.166424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.167237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.189694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 630/1260] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.190614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.197851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 631/1261] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.198679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.204358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8b7d-9bb4-4f00-9d27-6cd90745a891 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.260833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521225b-5943-49f2-9307-ca28a5fd73c9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.261313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.261921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.262195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.262454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.263124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.265093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.265892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.266505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.266782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.267054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.267697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.269329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.279657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 632/1262] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.280461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.289062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 631/1263] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.289959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.293120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da67bd-3039-4377-9ff5-7fb11cfe435c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.297756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.298358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.298636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.298907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.299544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.299661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c19f17-37ab-4eea-912f-69c818468028 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.301177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c1616-6c28-4b19-8a38-f7998c36aca1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.304157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.304733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.305022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.305366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.305990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.307845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.312803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 633/1264] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.312803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.312803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.312803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.334584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 632/1265] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.334584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.335222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:58.335222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:58.341746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e210151-79bd-412c-8b4c-7ae8ffcd2e40 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.343989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.346443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.347033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.347303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.347564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.348200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.349940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.360482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 633/1266] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.361124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.370237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9e0a-715d-4771-b769-2bf6622e2814 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.374976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.375544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.375813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.376073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.376686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.378282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.388299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 634/1267] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.391983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.401062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77e886-a614-43de-9947-71f48ece2660 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.404481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 634/1268] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:58.405356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.405574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.406139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.406414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.406681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.407289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.409174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.415496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935403-ef60-4fc0-93b2-80df39b0271e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.420341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.422037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.422632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.422875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.423149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.423848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.425487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.434442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 635/1269] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:58.435234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.436073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 635/1270] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.436872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.450139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a0bc-aa90-4262-8e54-c075fc4fb6ed admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.450395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2aa2b-9936-4e4f-94da-c3c9e844672b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.455036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.455752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.456025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.456132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.456291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.456651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.456920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.457051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.457255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.457875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.458521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.459569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.469042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 636/1271] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.469042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.472280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 636/1272] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.472280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.480276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd6a9a-8507-4dbf-bd2d-b7905463532c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.481972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab012-9a17-4bbd-8207-a5e22ee7275d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.484816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.485456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.485697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.485958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.486571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.487155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.487768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.488046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.488140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.488316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.488944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.491200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.498150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 637/1273] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.498931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.504056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 637/1274] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.504056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.508551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2032c-eafd-4246-b0a6-2cf0a6c528c7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.513426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.514334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.514797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.515272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.516391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.519162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.529375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 638/1275] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.530133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.539517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc32e-af77-4d95-9bfe-bee9dc73019c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.544457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.545210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.545624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.545971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] PATH_INFO: `/v3/projects/a2aada1700df4e9ea29cd3e7044d61b3/users/1daca405d28e422fbd42411ffd7d26d8/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.562956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7191d-e461-4b51-b0a8-ca2991f7b166 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.566615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.567226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.567479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.568146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.568253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2aada1700df4e9ea29cd3e7044d61b3, user_id=1daca405d28e422fbd42411ffd7d26d8, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.570439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.578905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.580633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.585168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 639/1276] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:58 2022] PUT /identity/v3/projects/a2aada1700df4e9ea29cd3e7044d61b3/users/1daca405d28e422fbd42411ffd7d26d8/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:58.586101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.592140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 638/1277] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:58.592942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.607746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774e9e3-9896-4ca2-80d7-7bc22f330ef0 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.652715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cffbd8-e5ce-46b4-9c8e-79fde142ed64 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.657804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.658883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.659229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.659501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.660245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.661887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.675089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 640/1278] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.675366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.675366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.675537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.675623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.675623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.675623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.675973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.683195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b69f91-5df3-49ef-b9a2-c71b1ca49c70 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.687855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.688511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.688849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.689149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] PATH_INFO: `/v3/projects/f2577363d54f4ac6a4cb0309a4974415/users/bbbde485e34442979c96792da000155f/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.691659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 639/1279] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.693270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.704030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845fee6-c326-45b8-94c0-1d5219f45d3c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.706774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2577363d54f4ac6a4cb0309a4974415, user_id=bbbde485e34442979c96792da000155f, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.708850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.709696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.710034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.710301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] PATH_INFO: `/v3/projects/c031531b0df4448d8620dd38c8963b60/users/33ec4b15c4c844ae8c3af6e1ee483fca/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.711557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.727163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c031531b0df4448d8620dd38c8963b60, user_id=33ec4b15c4c844ae8c3af6e1ee483fca, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.731766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 641/1280] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:58 2022] PUT /identity/v3/projects/f2577363d54f4ac6a4cb0309a4974415/users/bbbde485e34442979c96792da000155f/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:58.731766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.732001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.744397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.752498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 640/1281] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:58 2022] PUT /identity/v3/projects/c031531b0df4448d8620dd38c8963b60/users/33ec4b15c4c844ae8c3af6e1ee483fca/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:58.752498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.807468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:58.812172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e54559-1c1d-4679-8438-737a393a09a7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.816986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.817742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.818026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.818287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.819086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.820746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411ebb-0bea-4746-a0b0-c66163811db5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.823389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266310f-e090-491f-a472-eeeb69e632c3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.829984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.830763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.831734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.831846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 642/1282] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.832797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fb50-5361-4650-9746-67d119288360 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.833149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fb50-5361-4650-9746-67d119288360 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.833436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fb50-5361-4650-9746-67d119288360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.833891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] PATH_INFO: `/v3/projects/c94f3a1263404996973ddbec90ed1908/users/a6de413fa3fa4f2a84a4dc8f1289837e/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.852432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94f3a1263404996973ddbec90ed1908, user_id=a6de413fa3fa4f2a84a4dc8f1289837e, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.854881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7022fb50-5361-4650-9746-67d119288360 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:58.855824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.856251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7022fb50-5361-4650-9746-67d119288360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:58.866156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 643/1283] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:58.867277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fb50-5361-4650-9746-67d119288360 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.878186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 641/1284] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:58 2022] PUT /identity/v3/projects/c94f3a1263404996973ddbec90ed1908/users/a6de413fa3fa4f2a84a4dc8f1289837e/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:58.879406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:58.880465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fb50-5361-4650-9746-67d119288360 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.945584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.946279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.946550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.946815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.947468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.949843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a3a35-190d-4aa8-9005-05767cd77d8a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.953822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a1202-93e4-41ca-a96b-7c0a82edd4df admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:58.958913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:58.959899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.963558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 644/1285] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:41:58.963731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.963731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] PATH_INFO: `/v3/projects/6e42db4719364ce98768834f8eb01b3f/users/8286193d9cef421ebdf2d82967f49929/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.963918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54c3c-e167-441b-8a20-19f72b78ac87 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.963918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54c3c-e167-441b-8a20-19f72b78ac87 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.963918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54c3c-e167-441b-8a20-19f72b78ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:58.980423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0af54c3c-e167-441b-8a20-19f72b78ac87 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:58.981342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e42db4719364ce98768834f8eb01b3f, user_id=8286193d9cef421ebdf2d82967f49929, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:58.981642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0af54c3c-e167-441b-8a20-19f72b78ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:58.984613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:58.989468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 645/1286] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:58.990674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:58.991024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:58.991260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.009141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 642/1287] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:58 2022] PUT /identity/v3/projects/6e42db4719364ce98768834f8eb01b3f/users/8286193d9cef421ebdf2d82967f49929/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:59.010016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.021880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] MFA Rules not processed for user `33ec4b15c4c844ae8c3af6e1ee483fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.023300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.085664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ae01-bedc-45c5-a502-b0f7a5cd0c99 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.090558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.091236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.091509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.091863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] PATH_INFO: `/v3/projects/039e94e71b8c4b2ca2d7817b45e1225e/users/d757b35af4cd4ed08e063b984426e0d6/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.101260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 646/1288] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.102162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.110840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039e94e71b8c4b2ca2d7817b45e1225e, user_id=d757b35af4cd4ed08e063b984426e0d6, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.113685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285521df-c830-48ce-8f0c-069f952473d3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.125416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:59.133104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 643/1289] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:59 2022] PUT /identity/v3/projects/039e94e71b8c4b2ca2d7817b45e1225e/users/d757b35af4cd4ed08e063b984426e0d6/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:59.134371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.134903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.135177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.171813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] MFA Rules not processed for user `a6de413fa3fa4f2a84a4dc8f1289837e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.173220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.177675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b47d4-ae17-4586-863d-8ae4220e75c6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.201801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:59.233505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.234173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.234385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.234703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.253966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 644/1290] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.254996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.314875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.316552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.332053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 647/1291] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:59.333310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.334838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.343246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c67c90-1afa-4678-ab96-63fd90c84331 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.347350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8af2f-39a1-4759-b3af-a47ddbe40453 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.349445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.350212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.350492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.350780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] PATH_INFO: `/v3/projects/672db51cc9e8452ea83616390536514b/users/a9f13d57ca4a40f6811758eb5103c8e2/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.353616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.354672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.355146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.355962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.369288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.369750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672db51cc9e8452ea83616390536514b, user_id=a9f13d57ca4a40f6811758eb5103c8e2, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.371536 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114320-d693-4ba5-98e0-c4d696b8e581 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.372419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.384346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 648/1292] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:59.386247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c571af-43b6-4bc5-b920-73cb1ce4a8d5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.386790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c571af-43b6-4bc5-b920-73cb1ce4a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.387264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c571af-43b6-4bc5-b920-73cb1ce4a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.389541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 645/1293] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:41:59 2022] PUT /identity/v3/projects/672db51cc9e8452ea83616390536514b/users/a9f13d57ca4a40f6811758eb5103c8e2/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:41:59.390374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.411518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-28c571af-43b6-4bc5-b920-73cb1ce4a8d5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.413229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-28c571af-43b6-4bc5-b920-73cb1ce4a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.455369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962bdd-37a2-4387-9237-70ba825c7e82 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.460611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.461334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.461535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.461798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.498772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 649/1294] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.504234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11893a5-b8e9-4452-ae1b-910b32642374 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.504628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11893a5-b8e9-4452-ae1b-910b32642374 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.505033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11893a5-b8e9-4452-ae1b-910b32642374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.526392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.527774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.533816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:59.539386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 646/1295] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:59.541026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.547285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:41:59.548992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a11893a5-b8e9-4452-ae1b-910b32642374 None None] MFA Rules not processed for user `d757b35af4cd4ed08e063b984426e0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.550509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a11893a5-b8e9-4452-ae1b-910b32642374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.645784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3ae7-3acd-4378-a3b0-c29006a340a5 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.649772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 650/1296] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.649772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8f03-cfab-4720-aee1-6796924d8ea9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.649772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8f03-cfab-4720-aee1-6796924d8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.649772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8f03-cfab-4720-aee1-6796924d8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.661923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.662695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.662969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.664360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.670783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-abea8f03-cfab-4720-aee1-6796924d8ea9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.672226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-abea8f03-cfab-4720-aee1-6796924d8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.683463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 651/1297] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.685092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74533-2a7a-4bd1-86b2-ed9164824257 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.685329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74533-2a7a-4bd1-86b2-ed9164824257 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.685645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c74533-2a7a-4bd1-86b2-ed9164824257 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.687348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 652/1298] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:41:59.688056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74533-2a7a-4bd1-86b2-ed9164824257 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.779353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c74533-2a7a-4bd1-86b2-ed9164824257 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.785362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.786024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.786278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.786537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.788565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.794904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.798768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.800983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f106b6b-104a-45ca-9f2a-48fa8e4075c2 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.810944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 647/1299] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:59.811783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.816607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 653/1300] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:41:59.818762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.818762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.818762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.839245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860bd52-2da8-4bd7-b9af-8dfec76d61bc service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.846925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:41:59.848025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.848856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.849425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.851957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:41:59.857145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8cbff-4dc8-480d-ae9d-0c8b14603eb9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:41:59.863076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:41:59.867923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:41:59.891343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 654/1301] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:41:59.892131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:41:59.910513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 648/1302] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:41:59.914072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8711e1-0e15-4a25-88fb-fa433791adbc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:41:59.914620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8711e1-0e15-4a25-88fb-fa433791adbc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:41:59.915527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8711e1-0e15-4a25-88fb-fa433791adbc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:41:59.918530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b2c18-9449-43d0-a5d9-d9671216e973 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:41:59.920219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 649/1303] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 11 06:41:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:41:59.920786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8711e1-0e15-4a25-88fb-fa433791adbc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.055624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.056474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.056754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.057746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.092172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8711e1-0e15-4a25-88fb-fa433791adbc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.100439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.101193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.101879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.102756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.103457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.106166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a8bbf-7127-4d1f-9794-3ff2448b93c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.145164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:00.156385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 650/1304] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:41:59 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:00.158590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.158742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.159067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.199722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.202058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.221505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:00.227428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:00.229819 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 655/1305] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:00.233796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.239899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:00.265425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab3a6b-8559-4509-83e3-e8e6dcaa4694 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.278080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.279055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.279186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.279471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.280054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.282022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.295198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 656/1306] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:00.299796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.319501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4bec-91e2-49f4-a151-ce686f1d9aa0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.334878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.335615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.335858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.336098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] PATH_INFO: `/v3/projects/a226aaaba0a64598bdfbc1d5b445172a/users/09b92ef9f3754bc6a90deb2ff98bb00b/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.358787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 651/1307] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:00.372890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a226aaaba0a64598bdfbc1d5b445172a, user_id=09b92ef9f3754bc6a90deb2ff98bb00b, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.373825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.375619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.394797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 657/1308] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:00 2022] PUT /identity/v3/projects/a226aaaba0a64598bdfbc1d5b445172a/users/09b92ef9f3754bc6a90deb2ff98bb00b/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:00.402802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.488915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002ab01-16db-40ab-b41a-98e6876f6194 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.510181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784afae4-0736-4c83-b53a-ea10601cdbfa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.515120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.516129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.516129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.516338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.517097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.519046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.541678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 658/1309] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:00.545451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.557196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c81cd-e9a3-484f-94fa-0f5cdd27d9eb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.567563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.569205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.570327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.571781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] PATH_INFO: `/v3/projects/a226aaaba0a64598bdfbc1d5b445172a/users/09b92ef9f3754bc6a90deb2ff98bb00b/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.577475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a226aaaba0a64598bdfbc1d5b445172a, user_id=09b92ef9f3754bc6a90deb2ff98bb00b, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.581938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44158999-3850-4033-af0c-aad4b73ad3d6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.618330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 659/1310] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:00 2022] PUT /identity/v3/projects/a226aaaba0a64598bdfbc1d5b445172a/users/09b92ef9f3754bc6a90deb2ff98bb00b/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:00.624380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.624380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.624380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.669782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.670431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.670706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.670975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:00.719509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] MFA Rules not processed for user `09b92ef9f3754bc6a90deb2ff98bb00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:00.723448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:00.818675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:00.821092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:00.828074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:00.838937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 652/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:00.875597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 660/1312] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:00.888914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:00.903120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f02f-f8ad-43a9-a1aa-c4272b2ed120 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:00.980983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:00.981702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:00.983295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:00.983590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:01.004277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:01.005829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:01.029502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 653/1313] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:01.138460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:01.152956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5035ec-5a61-4e70-9a5a-8161f55f2382 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:01.158170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:01.159203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:01.159590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:01.160016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:01.173798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:01.254916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:01.256754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2f9a2-52e5-4040-976f-24d6cd228085 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:01.269659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 661/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:02.462750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:02.616893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a390-8362-4daf-b913-38746250570f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:02.617417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a390-8362-4daf-b913-38746250570f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:02.617973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a390-8362-4daf-b913-38746250570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:02.656770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80ae70-5b06-480f-82bf-bb5730b1e29d service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:02.682835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:02.683859 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:02.684732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:02.687020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] PATH_INFO: `/v3/users/4574fd9294294b30bf378b3769c6cc01` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:02.690082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4574fd9294294b30bf378b3769c6cc01)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:02.692199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c6d6a390-8362-4daf-b913-38746250570f None None] MFA Rules not processed for user `8286193d9cef421ebdf2d82967f49929`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:02.693930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c6d6a390-8362-4daf-b913-38746250570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:02.694186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:42:02.694186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: warnings.warn(msg) Oct 11 06:42:02.694186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: Oct 11 06:42:02.695858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:02.906626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 662/1315] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:02.910833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a390-8362-4daf-b913-38746250570f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:02.925845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a390-8362-4daf-b913-38746250570f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:02.931900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:02.933764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:02.934045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:02.934642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:02.935684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:02.938205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:02.958030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4574fd9294294b30bf378b3769c6cc01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:02.959179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4574fd9294294b30bf378b3769c6cc01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:02.982393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4574fd9294294b30bf378b3769c6cc01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:03.011574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 663/1316] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:02 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:03.012930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.035118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4574fd9294294b30bf378b3769c6cc01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:03.062147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5e58be12-f270-4879-b5e9-7ab8081a4e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4574fd9294294b30bf378b3769c6cc01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:03.080897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 654/1317] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:02 2022] DELETE /identity/v3/users/4574fd9294294b30bf378b3769c6cc01 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:03.086330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.086637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.086886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.130410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:03.131707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:03.157423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:03.175657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2103ba-25a9-4264-9803-5ebcb1581a01 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.229828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:03.232258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 655/1318] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:03.246244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.247880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:03.313576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.340873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.342591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.343968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.345316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.354458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.413814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2288-8cf2-4bad-b3bf-073698f0c418 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.419389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.420271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.420690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.421078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.435029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 664/1319] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:03 2022] POST /identity/v3/users => generated 309 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:03.436034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.439804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:03.445504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.452275 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.471518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 656/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:03.474959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67fc4-b883-4fd4-aa00-45cf29f1c37e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.490458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.491119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.491393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.491645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.493089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.494711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.528438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 665/1321] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:03.530809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.548132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43b600-f58d-4e25-ae50-1df45a4266de service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.556548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.557864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.558422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.558950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] PATH_INFO: `/v3/projects/8e2d40249aa64504a66c219d6af97614/users/af98aaf382584b779a02c7803b6dd3bb/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.579073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2d40249aa64504a66c219d6af97614, user_id=af98aaf382584b779a02c7803b6dd3bb, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.582573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.628346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 657/1322] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:03 2022] PUT /identity/v3/projects/8e2d40249aa64504a66c219d6af97614/users/af98aaf382584b779a02c7803b6dd3bb/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:03.632493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.658500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3291f8-0f3b-44cc-879a-c530568b97f9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.810893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.811613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.811797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.812132 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.812794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.818653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.851624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 666/1323] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:03.852806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:03.884256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15faf5c-6fbf-4ede-93ab-7cbf4ad8a8d4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:03.917664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:03.918981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:03.919852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:03.922197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] PATH_INFO: `/v3/projects/8e2d40249aa64504a66c219d6af97614/users/af98aaf382584b779a02c7803b6dd3bb/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:03.926619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2d40249aa64504a66c219d6af97614, user_id=af98aaf382584b779a02c7803b6dd3bb, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:03.934579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccecae7-f84a-47b9-9733-e690605e72db admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:03.962858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 658/1324] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:03 2022] PUT /identity/v3/projects/8e2d40249aa64504a66c219d6af97614/users/af98aaf382584b779a02c7803b6dd3bb/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:04.792939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:04.801476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:04.829360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629de1-c9e8-4004-9b51-8d25d3a42a0c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:04.971693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:04.972428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:04.972641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:04.972909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] PATH_INFO: `/v3/projects/dc10a50346f64d9fa97518f2019e3c75` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:04.978644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc10a50346f64d9fa97518f2019e3c75)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:04.979674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 06:42:04.979674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: warnings.warn(msg) Oct 11 06:42:04.979674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: Oct 11 06:42:04.980898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:05.118751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:05.134513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc10a50346f64d9fa97518f2019e3c75', 'request_id': 'req-49373c93-ebc0-4f77-ac11-957761170b43'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:05.159312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc10a50346f64d9fa97518f2019e3c75', 'request_id': 'req-49373c93-ebc0-4f77-ac11-957761170b43'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:05.178674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc10a50346f64d9fa97518f2019e3c75', 'request_id': 'req-49373c93-ebc0-4f77-ac11-957761170b43'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:05.237164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] The token cache is being invalidate because project dc10a50346f64d9fa97518f2019e3c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:05.237466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:05.245636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49373c93-ebc0-4f77-ac11-957761170b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:05.247808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 667/1325] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:04 2022] DELETE /identity/v3/projects/dc10a50346f64d9fa97518f2019e3c75 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:05.252935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:05.253530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:05.253530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:05.319278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:05.325333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:05.517444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 659/1326] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:05.519901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:05.520241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:05.520514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:05.577625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:05.582543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:05.616092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 668/1327] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:05.621635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:05.637821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd7ded-43f9-4812-9e7d-9f6513869cfe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:05.655255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:05.655892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:05.656167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:05.656434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:05.657478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:05.657783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:05.659491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:05.687285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 660/1328] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:05.691606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:05.707669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf76a-ac81-4cc9-8f66-4cd0fe343fa0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:05.729400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:05.730222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:05.730353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:05.730586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:05.731260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:05.734354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:05.803904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 669/1329] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:05 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:05.808313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:05.825308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85ee9-bcf7-4614-9890-4588c42e11f2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:05.844299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:05.958663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:05.959487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:05.959830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:05.962485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:05.963424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:05.965472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:06.012274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 661/1330] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:05 2022] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:06.013736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:06.037379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0585fb0-21cc-4c0e-b602-b4068bf98af6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:06.058510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:06.059260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:06.059607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:06.059946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:06.060675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:06.065722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:06.108945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 670/1331] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:06.110365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:06.125744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd39e1-d913-4ed0-942b-291aa1fbc3d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:06.137881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:06.138841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:06.139175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:06.139511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:06.140753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:06.145397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf41b2f-024b-4608-8714-cbf659f12c97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:06.165218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 662/1332] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:06.169593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:06.195363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5688b86-a92c-4270-ba24-39bb564f110f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:06.202304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:06.203219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:06.203647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:06.204126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] PATH_INFO: `/v3/projects/a45b95b485fe4744a682add5a46f4e4c/users/e0ba0dae4d7f47dc94f4719e6854c510/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:06.226287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45b95b485fe4744a682add5a46f4e4c, user_id=e0ba0dae4d7f47dc94f4719e6854c510, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:06.230450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:06.261073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 671/1333] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:06 2022] PUT /identity/v3/projects/a45b95b485fe4744a682add5a46f4e4c/users/e0ba0dae4d7f47dc94f4719e6854c510/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:06.266119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:06.266679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:06.266909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:06.328629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] MFA Rules not processed for user `e0ba0dae4d7f47dc94f4719e6854c510`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:06.330283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:06.431034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 663/1334] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:06.435615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:06.595413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbebe1e-a62a-498f-a4d4-0fde931e10e4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:06.607528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:06.608778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:06.610107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:06.610388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:06.612140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:06.615867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:06.713512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 672/1335] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:06 2022] POST /identity/v3/projects => generated 403 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:42:06.714230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:06.755901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcad2cb-24a4-4697-8d96-9306fb170e2b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.028900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.029574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.029846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.030112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.030758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.032738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.104942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 664/1336] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:06 2022] POST /identity/v3/users => generated 308 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:42:07.105560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.121941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbfcb-6e59-427e-8499-5ee955ceb0c2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.136191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.136835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.137141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.137417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.142786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.144468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.186942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 673/1337] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:07.188174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.204267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68219-0079-45aa-9caf-e5e5a6932ac8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.217773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.218531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.218973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.219481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] PATH_INFO: `/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32/users/3a703ad6005c4f70898e9cb1bcbef66f/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.236308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.238186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:07.245510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:07.271553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90bc455c79e4064a01ec2f2b4a00e32, user_id=3a703ad6005c4f70898e9cb1bcbef66f, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.274105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ff18-ff0f-4258-a3d2-6a0e92d7f5d1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.275073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.289396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.290081 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.290491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.290757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] PATH_INFO: `/v3/users/a6de413fa3fa4f2a84a4dc8f1289837e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.292216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6de413fa3fa4f2a84a4dc8f1289837e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.294666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.333561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 665/1338] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:07 2022] PUT /identity/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32/users/3a703ad6005c4f70898e9cb1bcbef66f/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:07.334772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.388841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:07.407290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6de413fa3fa4f2a84a4dc8f1289837e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:07.426625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6de413fa3fa4f2a84a4dc8f1289837e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:07.451267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6de413fa3fa4f2a84a4dc8f1289837e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:07.452336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6de413fa3fa4f2a84a4dc8f1289837e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:07.481975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4f84478b-c3d0-4557-95b6-a6d685727dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6de413fa3fa4f2a84a4dc8f1289837e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:07.497185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 674/1339] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:07 2022] DELETE /identity/v3/users/a6de413fa3fa4f2a84a4dc8f1289837e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:07.504241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251bba-0058-4107-90f1-e8faa08b236f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.504530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251bba-0058-4107-90f1-e8faa08b236f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.504806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251bba-0058-4107-90f1-e8faa08b236f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.535557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffe9e9-fbe4-410d-ab69-c08e563a1890 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.566234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9e251bba-0058-4107-90f1-e8faa08b236f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:07.571417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9e251bba-0058-4107-90f1-e8faa08b236f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:07.690292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.691749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.693211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.693588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.694557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.697234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.720147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 675/1340] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:07.723526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 666/1341] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:42:07.736755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.739488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:07.779572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e3af-76a3-45c4-991b-e3c0bbe32177 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:07.799665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:07.799665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.799665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.799665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] PATH_INFO: `/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32/users/3a703ad6005c4f70898e9cb1bcbef66f/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.801977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90bc455c79e4064a01ec2f2b4a00e32, user_id=3a703ad6005c4f70898e9cb1bcbef66f, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:07.810871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:07.839471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e91d2-ceed-4bf1-90a6-1ae98473fe85 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:07.840119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e91d2-ceed-4bf1-90a6-1ae98473fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:07.840577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e91d2-ceed-4bf1-90a6-1ae98473fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:07.843905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 667/1342] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:07 2022] PUT /identity/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32/users/3a703ad6005c4f70898e9cb1bcbef66f/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:07.848144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:07.863330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:07.938099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-607e91d2-ceed-4bf1-90a6-1ae98473fe85 None None] MFA Rules not processed for user `3a703ad6005c4f70898e9cb1bcbef66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:07.940024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-607e91d2-ceed-4bf1-90a6-1ae98473fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:08.025031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e972-e0a1-4396-9bf5-9bf095c84bac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:08.030657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:08.032345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:08.033540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:08.034039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:08.221274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 676/1343] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:08.225626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:08.226130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:08.226653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:08.229947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:08.302348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] MFA Rules not processed for user `af98aaf382584b779a02c7803b6dd3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:08.306698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:08.307332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:08.308809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:08.346323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 668/1344] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:08.347459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:08.350498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:08.445166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:08.520977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df7c80-62cd-4fa9-9f22-3898764281ed service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:08.532592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:08.536183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:08.536459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:08.536724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:08.549117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 677/1345] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:08.582218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:08.582218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1af2e0-d2cf-435d-9d7a-16fcdfedf4cf service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:08.591151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 669/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:08.872210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:08.892454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834d628-eb91-48d9-b155-c5d5d1b3f6d8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:08.900689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:08.901389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:08.901812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:08.902085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] PATH_INFO: `/v3/users/e0ba0dae4d7f47dc94f4719e6854c510` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:08.905794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ba0dae4d7f47dc94f4719e6854c510)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:08.910230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:09.027192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ba0dae4d7f47dc94f4719e6854c510'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:09.045119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ba0dae4d7f47dc94f4719e6854c510'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:09.093220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ba0dae4d7f47dc94f4719e6854c510'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:09.096949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ba0dae4d7f47dc94f4719e6854c510'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:09.130257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ba0dae4d7f47dc94f4719e6854c510'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:09.155515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 678/1347] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:08 2022] DELETE /identity/v3/users/e0ba0dae4d7f47dc94f4719e6854c510 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:09.160708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972027d-27de-411a-a76d-308ddc9468e4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:09.161101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972027d-27de-411a-a76d-308ddc9468e4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:09.161375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972027d-27de-411a-a76d-308ddc9468e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:09.224749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e972027d-27de-411a-a76d-308ddc9468e4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:09.226046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e972027d-27de-411a-a76d-308ddc9468e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:09.378561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 670/1348] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:09.433770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:09.436622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:09.583306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdec67-4b69-48a0-a23f-f056e0b237fd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:09.587731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:09.588359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:09.588631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:09.588894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:09.625263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:09.626885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4360d87-52e9-473e-8e23-63cd5c5482b5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:09.661467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 679/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:10.981961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399592-1305-4a38-977f-16108df03f0d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:10.982538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399592-1305-4a38-977f-16108df03f0d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:10.982627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad399592-1305-4a38-977f-16108df03f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:11.045434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ad399592-1305-4a38-977f-16108df03f0d None None] MFA Rules not processed for user `1daca405d28e422fbd42411ffd7d26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:11.052730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ad399592-1305-4a38-977f-16108df03f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:11.173900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:11.184803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 671/1350] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:11.195674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:11.196291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:11.196291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:11.226923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] MFA Rules not processed for user `1daca405d28e422fbd42411ffd7d26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:11.228575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:11.237827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 680/1351] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:11.250068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399592-1305-4a38-977f-16108df03f0d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:11.251829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ad399592-1305-4a38-977f-16108df03f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:11.364696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:11.367195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:11.388790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a26098-6974-4169-ad04-47acbf8cbbb7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:11.394718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad399592-1305-4a38-977f-16108df03f0d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:11.400892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:11.403635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:11.404816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:11.405789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] PATH_INFO: `/v3/projects/a45b95b485fe4744a682add5a46f4e4c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:11.408010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45b95b485fe4744a682add5a46f4e4c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:11.411036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547661b-6102-416a-832f-260d3689e751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:11.411961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547661b-6102-416a-832f-260d3689e751 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:11.413321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547661b-6102-416a-832f-260d3689e751 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:11.413806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547661b-6102-416a-832f-260d3689e751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:11.414161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:11.434873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547661b-6102-416a-832f-260d3689e751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:11.437340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547661b-6102-416a-832f-260d3689e751 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:11.457032 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 672/1352] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:11.505127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:11.564869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45b95b485fe4744a682add5a46f4e4c', 'request_id': 'req-f12316b1-4497-40b6-ac69-243fc4b88365'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:11.585528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45b95b485fe4744a682add5a46f4e4c', 'request_id': 'req-f12316b1-4497-40b6-ac69-243fc4b88365'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:11.593704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45b95b485fe4744a682add5a46f4e4c', 'request_id': 'req-f12316b1-4497-40b6-ac69-243fc4b88365'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:11.619708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] The token cache is being invalidate because project a45b95b485fe4744a682add5a46f4e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:11.620206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:11.624306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:11.632393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 681/1353] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:11 2022] DELETE /identity/v3/projects/a45b95b485fe4744a682add5a46f4e4c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:11.636752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547661b-6102-416a-832f-260d3689e751 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:11.673602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547661b-6102-416a-832f-260d3689e751 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:11.877249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:11.878758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:11.947378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:11.948387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:11.949346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:11.949776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] PATH_INFO: `/v3/users/3a703ad6005c4f70898e9cb1bcbef66f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:11.952304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a703ad6005c4f70898e9cb1bcbef66f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:11.954589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:12.067797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12316b1-4497-40b6-ac69-243fc4b88365 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:12.077306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:12.082388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.083522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.083881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] PATH_INFO: `/v3/users/33ec4b15c4c844ae8c3af6e1ee483fca` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.085691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a703ad6005c4f70898e9cb1bcbef66f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.086769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ec4b15c4c844ae8c3af6e1ee483fca)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:12.088861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:12.090908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a703ad6005c4f70898e9cb1bcbef66f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.109369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a703ad6005c4f70898e9cb1bcbef66f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.140816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a703ad6005c4f70898e9cb1bcbef66f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.158762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f3b88455-7ccb-4d52-876d-1197f53f5c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a703ad6005c4f70898e9cb1bcbef66f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.169402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 673/1354] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:11 2022] DELETE /identity/v3/users/3a703ad6005c4f70898e9cb1bcbef66f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:12.171107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c82a-4cfc-4da0-9c6e-7ace6a9b7188 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.171740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c82a-4cfc-4da0-9c6e-7ace6a9b7188 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.172314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170c82a-4cfc-4da0-9c6e-7ace6a9b7188 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.179044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 674/1355] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:42:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:42:12.212285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ec4b15c4c844ae8c3af6e1ee483fca'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.227432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ec4b15c4c844ae8c3af6e1ee483fca'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.235419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.235987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.236520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.264289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:12.278213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ec4b15c4c844ae8c3af6e1ee483fca'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.279152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ec4b15c4c844ae8c3af6e1ee483fca'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.293108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:12.293350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6c8e166-6281-4278-99d5-34d5fe19a780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ec4b15c4c844ae8c3af6e1ee483fca'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:12.297093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:12.321659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 682/1356] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:11 2022] DELETE /identity/v3/users/33ec4b15c4c844ae8c3af6e1ee483fca => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:12.324247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fa35-d51a-4886-9f6f-6c3ee1b7b5a6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.324533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fa35-d51a-4886-9f6f-6c3ee1b7b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.324811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313fa35-d51a-4886-9f6f-6c3ee1b7b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.364426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b313fa35-d51a-4886-9f6f-6c3ee1b7b5a6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:12.365742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b313fa35-d51a-4886-9f6f-6c3ee1b7b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:12.441506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:12.464114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 675/1357] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:42:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:12.505272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 683/1358] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:12.572697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:12.573986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:12.616419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baec1-abd7-4770-8a2d-198cea2566bb None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.617308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baec1-abd7-4770-8a2d-198cea2566bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.617698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780baec1-abd7-4770-8a2d-198cea2566bb None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.619754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 684/1359] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 11 06:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:42:12.625924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.626177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.626717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.683726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f2e5-a1e3-4dc3-a720-1ab84860c310 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:12.710056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:12.711395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:12.828943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:12.839249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.842012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.842342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.857894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 685/1360] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:42:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:12.858754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:12.862743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:12.895127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:12.897397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:12.922429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 676/1361] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:12.923331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:12.933809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90618cd8-7e9c-48ff-aaa8-b5d82519565a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:12.947396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:12.949916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:12.950716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:12.951642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:12.960331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:12.962195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:12.977258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 677/1362] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:13.038577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:13.038964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb23db3-2093-45c2-a74d-2176253bb5fd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:13.041693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:13.055036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:13.055404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.055749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.056079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.074297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:13.076475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de747b-6bed-431a-a083-5b5a3d099c15 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:13.117046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 686/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:13.128454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2552e-95e9-43ca-acd5-1236a065dfce service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:13.172912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:13.180721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.181017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.183328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] PATH_INFO: `/v3/projects/c94f3a1263404996973ddbec90ed1908` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.186027 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94f3a1263404996973ddbec90ed1908)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:13.193845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:13.287255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:13.299831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94f3a1263404996973ddbec90ed1908', 'request_id': 'req-715cd489-4df0-418e-962f-1e27c13b50c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:13.321728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94f3a1263404996973ddbec90ed1908', 'request_id': 'req-715cd489-4df0-418e-962f-1e27c13b50c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:13.335738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94f3a1263404996973ddbec90ed1908', 'request_id': 'req-715cd489-4df0-418e-962f-1e27c13b50c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:13.363439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] The token cache is being invalidate because project c94f3a1263404996973ddbec90ed1908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:13.363735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:13.365799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-715cd489-4df0-418e-962f-1e27c13b50c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:13.367593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 678/1364] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:13 2022] DELETE /identity/v3/projects/c94f3a1263404996973ddbec90ed1908 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:13.372866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.373583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.373694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.427814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:13.428958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:13.563050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 687/1365] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:13.570994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.571287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.571526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.606943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:13.608171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:13.637014 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 679/1366] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:13.641866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:13.647166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:13.656083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd9a32-abd1-425a-ac92-b553524cd602 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:13.667782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:13.668425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.671926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.674799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.675517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:13.675823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:13.678478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:13.715850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 688/1367] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:13.720865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:13.732726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db451d2-049b-44b6-a918-92493eacaec5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:13.745334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:13.750037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.750565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.751034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.751894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:13.754086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:13.818814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 680/1368] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:13 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:13.823028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:13.840155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d9f4-33eb-41b8-8dfd-d9cfe10eef09 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:13.982015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:13.982940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:13.983189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:13.983455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:13.984241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:13.986367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.033952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 689/1369] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:13 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:14.038611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.059320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dba8d-e72e-47b0-ac52-c1b750026ffc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:14.065638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:14.066286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.066783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.067254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.068285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:14.070207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.094510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 681/1370] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:14.098424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.115655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d6fa-3f04-4fb1-98f5-71f8798985bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:14.130250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:14.130987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.131259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.131553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.132229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:14.133837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2345-3190-462e-803a-30e14ab89d4c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.148874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 690/1371] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:14.153150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.167257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b74f7-eb6b-42d4-b399-724a82407d6c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:14.173496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:14.174764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.175232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.175935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] PATH_INFO: `/v3/projects/d496b6231642432999c2bb026cb7d1b5/users/7d896d73ad2544f4a4229897c4252cf1/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.217089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be889-d187-40ec-849d-30d38f6e7270 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.217216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be889-d187-40ec-849d-30d38f6e7270 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.217484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be889-d187-40ec-849d-30d38f6e7270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.241922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d496b6231642432999c2bb026cb7d1b5, user_id=7d896d73ad2544f4a4229897c4252cf1, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:14.246641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5ae1-1610-4460-9750-db513ea277c4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.269690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-427be889-d187-40ec-849d-30d38f6e7270 None None] MFA Rules not processed for user `a9f13d57ca4a40f6811758eb5103c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:14.271210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-427be889-d187-40ec-849d-30d38f6e7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.280173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 682/1372] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:14 2022] PUT /identity/v3/projects/d496b6231642432999c2bb026cb7d1b5/users/7d896d73ad2544f4a4229897c4252cf1/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:14.292422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.292960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.293617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.391736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] MFA Rules not processed for user `7d896d73ad2544f4a4229897c4252cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:14.394667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.435122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 691/1373] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:14.437428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.437976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.438688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.495291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] MFA Rules not processed for user `bbbde485e34442979c96792da000155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:14.497823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.538365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 683/1374] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:14.539572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.541141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.617646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:14.634613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:14.693623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 692/1375] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:14.703728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.708769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11e60-64ab-45da-a252-a147fba7d72b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:14.729468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:14.730110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.730396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.730657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.750294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:14.766219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d724aa-5163-4e5d-89d8-7fb689f5003d service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.782249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 684/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:14.783127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.783413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.783676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.844179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] MFA Rules not processed for user `bbbde485e34442979c96792da000155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:14.845482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.856270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b882-9097-4ffb-8b96-c0020fe027bf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:14.868050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 685/1377] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:14.879466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:14.880315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:14.880660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:14.880926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:14.881784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:14.883581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:14.893070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.894922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:14.981717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 693/1378] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:14 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:14.982714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:14.991005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.114756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c090ac-155e-4dde-8bd4-7f35a2c30fc1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:15.206087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10216f0a-2ed3-49e7-b989-dc8b0b336696 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:15.224909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:15.233784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.234062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.234333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] PATH_INFO: `/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.241167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90bc455c79e4064a01ec2f2b4a00e32)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:15.243218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:15.336813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:15.337878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.337878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.338877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.348805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.372123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90bc455c79e4064a01ec2f2b4a00e32', 'request_id': 'req-5b4fe3af-ea89-4576-9d22-f1929b3b6356'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:15.394233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:15.396124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:15.402223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90bc455c79e4064a01ec2f2b4a00e32', 'request_id': 'req-5b4fe3af-ea89-4576-9d22-f1929b3b6356'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:15.410549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90bc455c79e4064a01ec2f2b4a00e32', 'request_id': 'req-5b4fe3af-ea89-4576-9d22-f1929b3b6356'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:15.422290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 686/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:15.423203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:15.431984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] The token cache is being invalidate because project a90bc455c79e4064a01ec2f2b4a00e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:15.432263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:15.432936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:15.438496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 694/1380] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:14 2022] DELETE /identity/v3/projects/a90bc455c79e4064a01ec2f2b4a00e32 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:15.439591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:15.442750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.451207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:15.457927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca38541-ba38-45a7-bca6-6e00adba2716 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:15.687457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:15.688023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.688295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.688563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.691568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:15.693612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4862b-24b7-4d23-8916-828d007b93d2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:15.741666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fe3af-ea89-4576-9d22-f1929b3b6356 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:15.758153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:15.758795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.759065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.759332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.764468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.770354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:15.793664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 687/1381] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:15 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:15.794984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.796717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.797884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.850692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:15.852217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.873514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 688/1382] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:15.874611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:15.877278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.904126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835763b6-3c1b-470d-af33-6d07f3a72162 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:15.906425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:15.907903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:15.911121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:15.911831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:15.912108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:15.912375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] PATH_INFO: `/v3/projects/c031531b0df4448d8620dd38c8963b60` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:15.917811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c031531b0df4448d8620dd38c8963b60)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:15.921831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:15.928424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 695/1383] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:15.929268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:15.940891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:15.980223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8aa86-30bc-4bac-826d-09f851cc6992 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.001850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.002499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.002775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.003041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.003688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.008575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4e0bb-6594-4a98-8f4b-9e7e93465dd1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.033546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 696/1384] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:16.034944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2af6-3307-4cd8-a5fb-bbd1c506550a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.035229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2af6-3307-4cd8-a5fb-bbd1c506550a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.035622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2af6-3307-4cd8-a5fb-bbd1c506550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.042578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c031531b0df4448d8620dd38c8963b60', 'request_id': 'req-d7e03850-1208-4c5e-abbc-f98ff10e0856'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:16.062592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c031531b0df4448d8620dd38c8963b60', 'request_id': 'req-d7e03850-1208-4c5e-abbc-f98ff10e0856'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:16.072069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c031531b0df4448d8620dd38c8963b60', 'request_id': 'req-d7e03850-1208-4c5e-abbc-f98ff10e0856'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:16.095746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] The token cache is being invalidate because project c031531b0df4448d8620dd38c8963b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:16.096047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:16.096934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:16.100003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 689/1385] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:15 2022] DELETE /identity/v3/projects/c031531b0df4448d8620dd38c8963b60 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:16.101150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.105746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:16.110993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-353e2af6-3307-4cd8-a5fb-bbd1c506550a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:16.114934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-353e2af6-3307-4cd8-a5fb-bbd1c506550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:16.280110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 697/1386] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:16.287353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.289030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.289412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.294616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e03850-1208-4c5e-abbc-f98ff10e0856 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.311468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.313489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.314828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.319204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] PATH_INFO: `/v3/projects/2acdc907da984fdc963c1afc96215a75/users/86ac0e8f9f0744bd822032f797a5a751/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.347111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:16.361830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:16.378635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acdc907da984fdc963c1afc96215a75, user_id=86ac0e8f9f0744bd822032f797a5a751, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.387565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41a90-453f-4c6c-889f-8a24aeb0e64d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.403429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 698/1387] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:16.413031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.432946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 690/1388] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:16 2022] PUT /identity/v3/projects/2acdc907da984fdc963c1afc96215a75/users/86ac0e8f9f0744bd822032f797a5a751/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:16.437385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.437665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.440920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.443677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791c0b-75cc-446f-a0df-6da5a4e2433a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.507336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:16.515292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:16.529243 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:16.631960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.632672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.633016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.633317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.633973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:16.634310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.636534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.658413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:16.672363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 699/1389] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:16.674077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.690355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e37b5f-798f-4413-bdac-0d20020324a0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.694926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 691/1390] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:16.699615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.717394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.719200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.720350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.720662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.721768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.722274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ef9f-7935-4992-9184-cb30a424a616 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.725481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.733470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.735243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.735520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.736476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.738332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.743962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.757749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 700/1391] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:16.758743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.782062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b28-d409-4aca-aa7b-1d305b669754 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.789563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:16.790205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:16.790478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:16.790788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:16.791607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:16.792090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:16.793842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:16.813140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 692/1392] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:16 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:16.814106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.834566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 701/1393] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:16.838950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:16.865615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fe0bf-f39a-45a8-b216-94132a680136 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:16.999181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df429d2-a288-4f01-ae52-945d5a02b692 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:17.011564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:17.012259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.012528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.012927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] PATH_INFO: `/v3/projects/2acdc907da984fdc963c1afc96215a75/users/86ac0e8f9f0744bd822032f797a5a751/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.016006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acdc907da984fdc963c1afc96215a75, user_id=86ac0e8f9f0744bd822032f797a5a751, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:17.019488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:17.032849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 693/1394] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:16 2022] PUT /identity/v3/projects/2acdc907da984fdc963c1afc96215a75/users/86ac0e8f9f0744bd822032f797a5a751/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:17.038244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:17.052107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:17.052790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.053090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.053362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.054016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:17.066591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b223f-ec9d-4132-9fe7-f5a7fca44c59 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:17.150548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 702/1395] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:16 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:17.151893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961f1e-caa4-4eb4-b3e8-cc26b969a541 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.152178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961f1e-caa4-4eb4-b3e8-cc26b969a541 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.152452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961f1e-caa4-4eb4-b3e8-cc26b969a541 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.156879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 703/1396] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:42:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:42:17.158402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.161276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.161580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.254971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1cec-3d4d-47f4-bc09-5f9fb18bd142 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:17.262784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:17.262948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] MFA Rules not processed for user `86ac0e8f9f0744bd822032f797a5a751`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:17.264081 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:17.264666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.265360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.265948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.268139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:17.274054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44588f3-85dc-4fa7-a2c8-62f3bc9d6c72 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:17.331473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 694/1397] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:17 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:17.336913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69dca9-1d1a-4988-86ac-a584a384ff44 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.337437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69dca9-1d1a-4988-86ac-a584a384ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.338097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69dca9-1d1a-4988-86ac-a584a384ff44 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.359061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 695/1398] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 11 06:42:17 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:42:17.377706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69dca9-1d1a-4988-86ac-a584a384ff44 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:17.449548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 704/1399] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:17.451709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:17.453255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:17.473993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cbbf9-b0a0-4036-b63f-d534b1e6d805 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:17.479796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:17.564108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:17.564886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.565434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.566491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] PATH_INFO: `/v3/users/8286193d9cef421ebdf2d82967f49929` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.567272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8286193d9cef421ebdf2d82967f49929)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:17.569165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:17.614385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:17.655895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69dca9-1d1a-4988-86ac-a584a384ff44 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:17.659706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8286193d9cef421ebdf2d82967f49929'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:17.673412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:17.674103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.674414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.674685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.675436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:17.677530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8286193d9cef421ebdf2d82967f49929'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:17.683278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7958-cf61-4da8-b843-0a8adf6894ee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:17.712276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8286193d9cef421ebdf2d82967f49929'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:17.717333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8286193d9cef421ebdf2d82967f49929'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:17.726511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 696/1400] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:17.731074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137c12-70df-4322-8e3a-78186f688a44 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.731430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137c12-70df-4322-8e3a-78186f688a44 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.731648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137c12-70df-4322-8e3a-78186f688a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.744428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8286193d9cef421ebdf2d82967f49929'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:17.774509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 705/1401] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:17 2022] DELETE /identity/v3/users/8286193d9cef421ebdf2d82967f49929 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:17.775349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:17.785415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:17.798464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-da137c12-70df-4322-8e3a-78186f688a44 None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:17.807037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-da137c12-70df-4322-8e3a-78186f688a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:17.948431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 697/1402] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:42:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:17.949848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:17.950203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:17.950917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:17.979181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:17.984753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:17.992829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914829d-6046-444e-af0f-f4fbcb1f5489 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.004541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.008239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.009699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.010889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.011880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.022915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.073607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 706/1403] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:17 2022] POST /identity/v3/users => generated 284 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:18.076052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.078617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.105389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 698/1404] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:42:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:18.107477 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.110508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.117676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:18.143573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bea29e-2820-4dee-8d42-c27423075130 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.154986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.155704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.155976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.157085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.157085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.162722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.194809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871153-71a9-4012-89e6-c42cfa6f406c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.202253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 699/1405] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:18.203606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.203966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.205745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.206045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.207531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.208206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.212239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.235865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dfd02-d61f-48b1-b914-e229f750e35e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.252750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.253728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.254006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.254273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.269814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.272931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.302171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 700/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:18.303661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.323291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d190a25-2ea1-45e1-bf7c-8fad226d8528 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.333739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.334350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.334627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.334893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.335576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.341218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.341920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.347064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.374062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 701/1408] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:18.374979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 707/1408] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:18.376175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.377588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.400312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9892-aca7-4cf3-9003-41efa24773dd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.413406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.414150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.414435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.414735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] PATH_INFO: `/v3/projects/078d50800fa4464e87e7609a292e173a/users/a2634a4aa11943948380861e105c4e92/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.430493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2797d3-91ba-4343-b43e-6b98db92b883 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.457534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.458304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.458704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.459044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.460395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.462185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.495363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 708/1409] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:18.496319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.511801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.544315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754c08-49b0-4ac3-b10f-e0b5e8f547a0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.551514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.552173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.552499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.553297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.571851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.573458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.592823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 709/1410] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:18.594248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.634069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805152-6cc4-4a3b-9753-f5d3d47f5520 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.648002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] RBAC: Authorizing `identity:create_grant(project_id=078d50800fa4464e87e7609a292e173a, user_id=a2634a4aa11943948380861e105c4e92, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.650893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.666163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.669572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.669901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.670184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] PATH_INFO: `/v3/projects/f9af1c4178264782a051d9eb3c21c8f5/users/d42b838b52284172a1e28d0409d7798f/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.686452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 702/1411] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:18 2022] PUT /identity/v3/projects/078d50800fa4464e87e7609a292e173a/users/a2634a4aa11943948380861e105c4e92/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:18.698511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.713998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9af1c4178264782a051d9eb3c21c8f5, user_id=d42b838b52284172a1e28d0409d7798f, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.720962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.767520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 710/1412] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:18 2022] PUT /identity/v3/projects/f9af1c4178264782a051d9eb3c21c8f5/users/d42b838b52284172a1e28d0409d7798f/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:18.771551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:18.778239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:18.815888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:18.860897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfafabe-c752-40e2-9bb1-d005c201448c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.915936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb31-c950-43c9-8f45-149d80929e0b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:18.928762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:18.929704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:18.930082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:18.930394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] PATH_INFO: `/v3/projects/6e42db4719364ce98768834f8eb01b3f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:18.931941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e42db4719364ce98768834f8eb01b3f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:18.936175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:18.988453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:19.002409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:19.005088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:19.005525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:19.005802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:19.017409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.048574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e42db4719364ce98768834f8eb01b3f', 'request_id': 'req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:19.068365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e42db4719364ce98768834f8eb01b3f', 'request_id': 'req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:19.084680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e42db4719364ce98768834f8eb01b3f', 'request_id': 'req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:19.118226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] The token cache is being invalidate because project 6e42db4719364ce98768834f8eb01b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:19.118520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:19.120256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6f9fae1-ceb9-43b0-974d-eaaa36de974f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:19.125682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 711/1413] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:18 2022] DELETE /identity/v3/projects/6e42db4719364ce98768834f8eb01b3f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:19.125682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:19.125682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:19.125682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:19.229990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:19.231171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] MFA Rules not processed for user `a2634a4aa11943948380861e105c4e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:19.231451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ae646-385e-495a-a8bc-32251e8232ef service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:19.235653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.262711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 703/1414] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:19.269620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:19.269905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:19.270171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:19.354993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] MFA Rules not processed for user `d42b838b52284172a1e28d0409d7798f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:19.356748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.515466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 712/1415] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:19.519966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:19.528727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.543691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 704/1416] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:19.545589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:19.551348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.775395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:19.837421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57209c-a1ea-4ceb-b81f-2c641080bbd2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:19.859928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:19.860735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:19.860876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:19.861094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] PATH_INFO: `/v3/users/af98aaf382584b779a02c7803b6dd3bb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:19.862850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af98aaf382584b779a02c7803b6dd3bb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:19.864526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d8a64-94aa-4d6b-9f7c-2abc94b2ccae None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:19.864872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:19.871358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:19.872220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:19.872827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:19.873305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:19.876458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:19.878929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:19.959069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 705/1417] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:19 2022] POST /identity/v3/projects => generated 387 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:19.960079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:19.969898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:19.988100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:20.011957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af98aaf382584b779a02c7803b6dd3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:20.025162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af98aaf382584b779a02c7803b6dd3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:20.054716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af98aaf382584b779a02c7803b6dd3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:20.056332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af98aaf382584b779a02c7803b6dd3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:20.065834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54b8833e-899c-4964-93e1-de702282aa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af98aaf382584b779a02c7803b6dd3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:20.098501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 713/1418] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:19 2022] DELETE /identity/v3/users/af98aaf382584b779a02c7803b6dd3bb => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:20.100829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad70c-0587-47b5-8e05-2cccd9796d06 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.103189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad70c-0587-47b5-8e05-2cccd9796d06 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.103634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ad70c-0587-47b5-8e05-2cccd9796d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.177600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08a26-0a9a-4836-b1e4-b949b4fbccce admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:20.262325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-436ad70c-0587-47b5-8e05-2cccd9796d06 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:20.264849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-436ad70c-0587-47b5-8e05-2cccd9796d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:20.328261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:20.331871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.331871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.331871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.341042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:20.348313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:20.429931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 706/1419] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:19 2022] POST /identity/v3/projects => generated 369 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:20.431263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.440065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:20.542069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 714/1420] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:42:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:20.544992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.545437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.545843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.619308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] MFA Rules not processed for user `bbbde485e34442979c96792da000155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:20.623425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:20.628922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:20.655508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db47da9-642d-4407-9f03-a61bf0d07e48 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:20.667314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:20.668217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.668650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.669081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.670282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:20.672924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:20.708824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 707/1421] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:20 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:20.712857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.718586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:20.743126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503d42-6117-4754-aa6f-92b2ac4639cc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:20.754199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:20.756018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.756315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.756587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.757896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:20.765488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:20.793364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 715/1422] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:20.795660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.843641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81eea-0fa1-4be6-943d-fae33ca83d0a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:20.847704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 708/1423] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:20 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:20.851211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.851525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:20.852360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.852803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.853375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.854346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:20.855104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:20.856365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:20.887885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 716/1424] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:20.889630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.900445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b9ee-e84a-491c-9165-e9843c9b302c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:20.912620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:20.913621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:20.914084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:20.914609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:20.915339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:20.917076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:20.962435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 717/1425] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:20.964525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:20.997262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1177c-ea4a-4bff-a073-204750504105 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.014672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.017068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.017293 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.017571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.018239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.019868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.034013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:21.062731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 718/1426] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:21.065983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:21.101313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb95a-2830-4d69-b43f-62440920c117 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.130428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.131313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.132880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.134606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] PATH_INFO: `/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d/users/b01d5744295043cfb938d9513f5a37f4/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.166998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1829f-35ef-4fb4-9bd8-7e6ac52e91d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.184908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f43a6e7cb7848e1ac3b88e4cfaecd8d, user_id=b01d5744295043cfb938d9513f5a37f4, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.187091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.187731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.188004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.188271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.191390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.220253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 719/1427] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:21 2022] PUT /identity/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d/users/b01d5744295043cfb938d9513f5a37f4/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:21.222731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:21.334726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.336348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.379886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 709/1428] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:42:21.380960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:21.391537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd084205-b1d0-45b3-82a9-c62f1eaaecc4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.402449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.404245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.404557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.404789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] PATH_INFO: `/v3/projects/042e2e86c7e9407c82f111add37b1d4a/users/dd6dedfbaa504d87bf311e3c38b16e30/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.405703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dff6e3-2575-48f6-873b-4677e9364b73 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.421388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.421949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.422222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.422503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.423242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.428163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.451136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042e2e86c7e9407c82f111add37b1d4a, user_id=dd6dedfbaa504d87bf311e3c38b16e30, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.460880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c78f9-7e4d-4a8e-ad76-3c1486d21e29 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.462596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 710/1429] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:21.466465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:21.496792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a39c02-a6a1-4a61-ad9e-858798d0c476 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:21.499885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 720/1430] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:21 2022] PUT /identity/v3/projects/042e2e86c7e9407c82f111add37b1d4a/users/dd6dedfbaa504d87bf311e3c38b16e30/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:21.513266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.513720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.514818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.606259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:21.646194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] MFA Rules not processed for user `dd6dedfbaa504d87bf311e3c38b16e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:21.661994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:21.744665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:21.747314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.750841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.751890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] PATH_INFO: `/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d/users/b01d5744295043cfb938d9513f5a37f4/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.758757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f43a6e7cb7848e1ac3b88e4cfaecd8d, user_id=b01d5744295043cfb938d9513f5a37f4, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:21.770277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12d05-6ab7-4138-85c0-3c8c9a4b03b9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:21.811075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 711/1431] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:21 2022] PUT /identity/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d/users/b01d5744295043cfb938d9513f5a37f4/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:21.818620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c9348-6ac4-469d-b21e-4959fd0ca1e9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:21.822485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c9348-6ac4-469d-b21e-4959fd0ca1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:21.823682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c9348-6ac4-469d-b21e-4959fd0ca1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:21.897645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 721/1432] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:21.898811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:21.902606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:21.902866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7c5c9348-6ac4-469d-b21e-4959fd0ca1e9 None None] MFA Rules not processed for user `a9f13d57ca4a40f6811758eb5103c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:21.904258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7c5c9348-6ac4-469d-b21e-4959fd0ca1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:21.935313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c88c3-5d6e-4c6c-9846-75b27e9e80a6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:22.107853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 712/1433] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:22.109571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:22.110690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:22.111173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:22.163840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] MFA Rules not processed for user `b01d5744295043cfb938d9513f5a37f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:22.165637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:22.171833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:22.192851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:22.193881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:22.195349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:22.196210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] PATH_INFO: `/v3/projects/8e2d40249aa64504a66c219d6af97614` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:22.197314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2d40249aa64504a66c219d6af97614)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:22.199917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:22.365727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2d40249aa64504a66c219d6af97614', 'request_id': 'req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:22.396832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2d40249aa64504a66c219d6af97614', 'request_id': 'req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:22.428330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2d40249aa64504a66c219d6af97614', 'request_id': 'req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:22.429569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 713/1434] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:22.430515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:22.471255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e6d8e-5b4d-42e8-874c-2d3e5cca75eb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:22.475858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] The token cache is being invalidate because project 8e2d40249aa64504a66c219d6af97614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:22.475858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:22.478002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:22.485609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 722/1435] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:21 2022] DELETE /identity/v3/projects/8e2d40249aa64504a66c219d6af97614 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:22.488964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:22.492366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:22.676372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:22.679108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:22.679371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:22.679650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:22.688019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:22.698178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdac3a-1e1a-4db7-b63b-296e1ad93195 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:22.722452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:22.748111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52006a98-abeb-4b5d-bc0f-47fec1d6fb57 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:22.766690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:22.768837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:22.769280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:22.770660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:22.777743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:22.812317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 714/1436] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:22 2022] POST /identity/v3/projects => generated 387 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:22.813654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:22.813942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:22.814210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:22.853872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:22.854931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:23.021112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 715/1437] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:23.021112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.021112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:23.085305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.086865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5395bbc-bd7f-4c31-8d7d-81eeec37fe81 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.089149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a386-9fbb-40bf-a290-35c8d724853b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:23.109089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:23.109915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.110221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.110541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.111218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.113300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.127387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 723/1438] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:23.128855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.129205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.129496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.188104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:23.191190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:23.192234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 716/1439] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:23 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:23.197035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.212028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4784a-53b0-4573-88ba-aec8390c84dd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:23.238250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 724/1440] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:23.239036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.244758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:23.256402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.256688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.256957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.258861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.260537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.296432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9b36a-f00c-42fa-8316-191b3df03e84 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:23.320886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:23.325079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 717/1441] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:23.325079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.332479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.336082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.337332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.340242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:23.340564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.354447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.417737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 725/1442] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:23.429906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.486586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f02176-6a2c-4ad4-a70a-f50096ceb1b9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:23.504359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:23.507126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.507477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.508611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] PATH_INFO: `/v3/projects/e80054bdc1de44ff933d004a134206a3/users/58699ae4db4d44478971a60836c982be/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.524775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:23.580020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80054bdc1de44ff933d004a134206a3, user_id=58699ae4db4d44478971a60836c982be, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.586070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e741ea-a730-4c3a-a1c2-086537502278 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.603913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f287-4eaa-4efc-9cac-65e58f4adc9a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:23.612440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:23.614901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.615198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.616610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.624071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:23.634715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 726/1443] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:23 2022] PUT /identity/v3/projects/e80054bdc1de44ff933d004a134206a3/users/58699ae4db4d44478971a60836c982be/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:23.639176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:23.639491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:23.639880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:23.727894 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:23.729653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:23.880044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 727/1444] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Oct 11 06:42:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:23.882244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.924288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:23.934350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:23.978856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 718/1445] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:23.983459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:23.989028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:24.039509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fec453-7cdd-4568-95c3-31936f691093 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.054712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a270b3-9163-4bae-99dd-6807ece953ac service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.055351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.057804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.058166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.060794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.061943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.068702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.081222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.081222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.081222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.081222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] PATH_INFO: `/v3/users/7d896d73ad2544f4a4229897c4252cf1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.081851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d896d73ad2544f4a4229897c4252cf1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.086253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.103918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:24.180125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 728/1446] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:23 2022] POST /identity/v3/projects => generated 381 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:24.181313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:24.250339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d896d73ad2544f4a4229897c4252cf1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:24.252741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d896d73ad2544f4a4229897c4252cf1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:24.278989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d896d73ad2544f4a4229897c4252cf1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:24.324944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b29f-53f3-424c-87bd-93bfd6ad87e5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.339445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.340172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.340514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.340865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.341597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.346311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.354299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d896d73ad2544f4a4229897c4252cf1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:24.381033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 729/1447] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:24.381033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:24.387818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d896d73ad2544f4a4229897c4252cf1'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:24.388008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:24.401420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 719/1448] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:23 2022] DELETE /identity/v3/users/7d896d73ad2544f4a4229897c4252cf1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:24.405900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:24.414178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:24.452071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:24.598322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b2dcb-8085-4e80-abe0-3aa5509439ba admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.734015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475fe51-e0cb-4504-9388-af0322f67e9e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.748028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.748784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.749059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.750199 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.751453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.751918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.752355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.752709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.762172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.763509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.786735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:24.808092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 720/1449] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:24 2022] POST /identity/v3/users => generated 291 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:24.809351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:24.814240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:24.832419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.836164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64356f-fb0f-4b91-95f7-a282b3c3fe4c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.847189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c465f0-bc9f-4035-9f6f-19c058fcf6bc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:24.854899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:24.855857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.856337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.856799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] PATH_INFO: `/v3/projects/e80054bdc1de44ff933d004a134206a3/users/58699ae4db4d44478971a60836c982be/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:24.870228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80054bdc1de44ff933d004a134206a3, user_id=58699ae4db4d44478971a60836c982be, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:24.874715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:24.902836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 730/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:24.905709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 721/1451] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:24 2022] PUT /identity/v3/projects/e80054bdc1de44ff933d004a134206a3/users/58699ae4db4d44478971a60836c982be/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:24.906779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:24.927592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:24.927883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:24.928156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.034474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:25.037591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:25.087908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f58c-96dc-4f67-b1e4-b51e531e2912 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:25.093879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:25.094823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.095302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.095777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.096798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:25.098727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e6a45-651c-463c-85f3-98170e1b1601 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:25.100712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:25.119230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 722/1452] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:25.122418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.129225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.129225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.196361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] MFA Rules not processed for user `58699ae4db4d44478971a60836c982be`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:25.198468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:25.281928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 731/1453] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:25.289308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:25.320400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcab3a-fa00-4047-9724-80b1801d2e8b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:25.331182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:25.332077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.332357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.334504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.345642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:25.351649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:25.393644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 732/1454] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:25.394374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:25.397976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:25.476296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 723/1455] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:25.479100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:25.530490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d282c6-d8a9-4098-91c6-7f68d4d1d531 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:25.554781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:25.556926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.558260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.560427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] PATH_INFO: `/v3/projects/dc5e7c0eb99d4a8cb6c8442b3ce7312c/users/fc7de4650e254dee872a679b047f9914/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.616249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8eed4-35a5-4717-8c83-e9cd770b378d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:25.622728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5e7c0eb99d4a8cb6c8442b3ce7312c, user_id=fc7de4650e254dee872a679b047f9914, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:25.631249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:25.632444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:25.632859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.633420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.633966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.661956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:25.670004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af4a1c-2f99-4ed4-a284-54bd8b712825 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:25.692848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 724/1456] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:25 2022] PUT /identity/v3/projects/dc5e7c0eb99d4a8cb6c8442b3ce7312c/users/fc7de4650e254dee872a679b047f9914/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:25.694122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:25.696940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:25.717368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 733/1457] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:25.719224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.719514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.719798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:25.765863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:25.834963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] MFA Rules not processed for user `fc7de4650e254dee872a679b047f9914`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:25.836791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:25.889737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe39ea-bea5-4fb7-bd23-fe4ff1fd6eb5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:25.896984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:25.899869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:25.900383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:25.901622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:26.015080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 734/1458] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:26.021538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:26.112422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:26.116980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:26.173638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 725/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:26.279843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510670-9822-4dd0-bc73-5786b183ef1d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:26.300785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:26.301507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:26.301833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:26.302163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:26.302906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:26.304884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:26.388360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 735/1460] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:26 2022] POST /identity/v3/projects => generated 381 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:26.392295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:26.415055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d208c87-d563-4dfe-99e1-1f8aa938dac1 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:26.427283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:26.734616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:26.735425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:26.737030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:26.737808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:26.744131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:26.751768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:26.836563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 726/1461] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:26 2022] POST /identity/v3/users => generated 297 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:26.838185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:26.862974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cce046-0cfe-4d0c-bdcc-6192c2f58a34 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:26.873893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:26.875583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:26.876014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:26.876465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:26.877668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:26.879653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:26.896693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 736/1462] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:26.900989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:26.920063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122034-78b3-440e-a98e-31e03abfa637 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:26.932943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:26.933694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:26.933968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:26.934233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] PATH_INFO: `/v3/projects/5e5e73a78dfb4b788271ee179d1118b4/users/aff021bb5acc444fb21722d0ea7755b7/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.009815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e73a78dfb4b788271ee179d1118b4, user_id=aff021bb5acc444fb21722d0ea7755b7, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:27.016665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:27.060085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 727/1463] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:26 2022] PUT /identity/v3/projects/5e5e73a78dfb4b788271ee179d1118b4/users/aff021bb5acc444fb21722d0ea7755b7/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:27.064658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:27.092323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2b3ac-8a7c-4a28-9f55-59af1710d854 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:27.328489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:27.332185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:27.332505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:27.333022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.333911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:27.335565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be7125-6425-4bd8-82ce-99b4af97dd87 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:27.369348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 737/1464] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:42:27.376763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:27.393840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f850d-4d3d-4092-9c03-81dc6e840695 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:27.407134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:27.408188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:27.411193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:27.411794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] PATH_INFO: `/v3/projects/5e5e73a78dfb4b788271ee179d1118b4/users/aff021bb5acc444fb21722d0ea7755b7/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.415888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e73a78dfb4b788271ee179d1118b4, user_id=aff021bb5acc444fb21722d0ea7755b7, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:27.422359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c3379-2f98-410b-a5d5-a492f418553c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:27.459426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 728/1465] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:27 2022] PUT /identity/v3/projects/5e5e73a78dfb4b788271ee179d1118b4/users/aff021bb5acc444fb21722d0ea7755b7/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:27.461360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:27.461810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:27.462150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.501609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:27.573161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] MFA Rules not processed for user `aff021bb5acc444fb21722d0ea7755b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:27.573161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:27.660155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb566-32bb-4dab-a7fc-c76682d6d231 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:27.660641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb566-32bb-4dab-a7fc-c76682d6d231 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:27.660773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbb566-32bb-4dab-a7fc-c76682d6d231 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.662142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 729/1466] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:42:27.740410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:27.740687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:27.740982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:27.786867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 738/1467] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:27.790108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:27.797793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:27.964106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 730/1468] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:42:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:28.215754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:28.217780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:28.264510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:28.266878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:28.296683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8f829-86d4-47f6-af77-f1070d4a39fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:28.310182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:28.311051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:28.311466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:28.311872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:28.332081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:28.336736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:28.374453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 731/1469] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:28.378277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a058c-746a-4b7b-bcd0-50bbfcabd4c2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:28.395812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:28.396735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:28.397452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:28.397806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:28.419221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:28.420700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:28.458587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 739/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:28.512072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:28.514445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:28.613665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:28.627880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:28.643836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a735a-65a9-456c-b47b-76a7a20420a7 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:28.672174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:28.672818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:28.673133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:28.680988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:28.714761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7164-07b2-4cf2-bb93-e8d6f65badc3 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:28.747503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:28.748179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:28.748459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:28.748721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] PATH_INFO: `/v3/projects/d496b6231642432999c2bb026cb7d1b5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:28.750611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d496b6231642432999c2bb026cb7d1b5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:28.752549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:28.849286 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:28.850908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:28.865121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 740/1471] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:28.924736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:28.935247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd496b6231642432999c2bb026cb7d1b5', 'request_id': 'req-a66be271-3f44-48df-b231-eafcd7d5041e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:28.946138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9debe-63ee-4278-948f-bc061e9f8efd service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:28.992136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd496b6231642432999c2bb026cb7d1b5', 'request_id': 'req-a66be271-3f44-48df-b231-eafcd7d5041e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.025627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd496b6231642432999c2bb026cb7d1b5', 'request_id': 'req-a66be271-3f44-48df-b231-eafcd7d5041e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.057493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] The token cache is being invalidate because project d496b6231642432999c2bb026cb7d1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:29.057869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.058580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.060555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 732/1472] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:28 2022] DELETE /identity/v3/projects/d496b6231642432999c2bb026cb7d1b5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:29.064466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:29.066040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:29.069276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:29.159100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:29.163495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:29.163792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:29.166372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:29.180348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:29.267341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66be271-3f44-48df-b231-eafcd7d5041e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:29.292434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:29.295584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:29.295915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:29.296252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] PATH_INFO: `/v3/users/86ac0e8f9f0744bd822032f797a5a751` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:29.305936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ac0e8f9f0744bd822032f797a5a751)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:29.307929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:29.396306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ac0e8f9f0744bd822032f797a5a751'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.397301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ac0e8f9f0744bd822032f797a5a751'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.413697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ac0e8f9f0744bd822032f797a5a751'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.415950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:29.417745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:29.446506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 741/1473] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:29.471100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:29.481244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ac0e8f9f0744bd822032f797a5a751'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.508880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ac0e8f9f0744bd822032f797a5a751'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:29.540127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 733/1474] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:29 2022] DELETE /identity/v3/users/86ac0e8f9f0744bd822032f797a5a751 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:31.371529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:31.373326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:31.432661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857339-efb6-4c43-8a6d-662e4b0f34e9 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:31.598410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:31.599157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:31.599434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:31.599702 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] PATH_INFO: `/v3/users/d42b838b52284172a1e28d0409d7798f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:31.601284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42b838b52284172a1e28d0409d7798f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:31.604222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:31.637249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:31.639360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:31.672603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed5d1-dd90-4f3d-a1a2-90986590a1c4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:31.692177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:31.693209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:31.693705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:31.694149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] PATH_INFO: `/v3/projects/2acdc907da984fdc963c1afc96215a75` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:31.697135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acdc907da984fdc963c1afc96215a75)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:31.700836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:31.755567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42b838b52284172a1e28d0409d7798f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.782987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42b838b52284172a1e28d0409d7798f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.804957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42b838b52284172a1e28d0409d7798f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.806082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42b838b52284172a1e28d0409d7798f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.806492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acdc907da984fdc963c1afc96215a75', 'request_id': 'req-4a1ac9d3-2e30-4873-ab13-6219e48bde46'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.817471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3bca5d3a-e47b-45e6-9ad9-f375f30f2778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42b838b52284172a1e28d0409d7798f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.828173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acdc907da984fdc963c1afc96215a75', 'request_id': 'req-4a1ac9d3-2e30-4873-ab13-6219e48bde46'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.831546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 742/1475] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:31 2022] DELETE /identity/v3/users/d42b838b52284172a1e28d0409d7798f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:31.835840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:31.835840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:31.835840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:31.842002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acdc907da984fdc963c1afc96215a75', 'request_id': 'req-4a1ac9d3-2e30-4873-ab13-6219e48bde46'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.862683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:31.869077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] The token cache is being invalidate because project 2acdc907da984fdc963c1afc96215a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:31.869465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.872534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a1ac9d3-2e30-4873-ab13-6219e48bde46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:31.878300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 734/1476] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:31 2022] DELETE /identity/v3/projects/2acdc907da984fdc963c1afc96215a75 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:31.879855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fe91-91b2-4229-a28b-390a43e76064 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:31.880260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fe91-91b2-4229-a28b-390a43e76064 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:31.880608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941fe91-91b2-4229-a28b-390a43e76064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:31.881193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:31.885017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:31.910682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7941fe91-91b2-4229-a28b-390a43e76064 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:31.912205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7941fe91-91b2-4229-a28b-390a43e76064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:32.032413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 735/1477] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:32.035683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.036252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.036661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.066657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:32.068249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:32.098265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 736/1478] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:32.100609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.108915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 743/1479] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:32.119555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99b084-92ae-4986-90e2-a536ba763c9f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.132646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.133949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.134601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.135425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.136272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:32.137300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.139100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.166948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.168611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:32.197981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 737/1480] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:32.203303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.236024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95c31-29e2-495a-a61c-5eabeeaa0788 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.255746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.256456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.256730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.257126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.257793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.259907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.343375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 738/1481] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:32 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:32.347861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.363715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df435-a995-4ce6-9f15-4fac9123f408 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.470044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:32.492155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.494201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.494201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.494201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.537992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80339-49b4-4e2b-af4f-49437db7668a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.551543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.552240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.552600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.552874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.553618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.555995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.617580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 739/1482] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:32 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:32.618714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.639298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97502-7dce-47db-837a-88c2ff0a048c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.652080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.653720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.653986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.654259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.654941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.656644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.688116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.690314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 740/1483] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:32.692019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.692274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.710276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 744/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:32.720319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e9c5-6176-4f7f-8bfc-dddfe25a098e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.736906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.737600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.738755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.739081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.739818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.741585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd74fd-c7bc-4474-96e0-1fa376d1d255 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.781393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 741/1485] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:32.781470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:32.799964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bad2ae-0e2a-4c14-be16-de1ea503e47a service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:32.819434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:32.820935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.821246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.821575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] PATH_INFO: `/v3/projects/082e394b7e8942f98018c44625fc50e2/users/c48b25976bbd4864a2c437d32bad3042/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.886805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:32.901297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=082e394b7e8942f98018c44625fc50e2, user_id=c48b25976bbd4864a2c437d32bad3042, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:32.912123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:32.952149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 745/1486] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:32 2022] PUT /identity/v3/projects/082e394b7e8942f98018c44625fc50e2/users/c48b25976bbd4864a2c437d32bad3042/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:32.964110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fff34-e79f-4828-9088-a6068a13273b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:32.964346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fff34-e79f-4828-9088-a6068a13273b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:32.964611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fff34-e79f-4828-9088-a6068a13273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:32.997138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-843fff34-e79f-4828-9088-a6068a13273b None None] MFA Rules not processed for user `c48b25976bbd4864a2c437d32bad3042`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:32.998555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-843fff34-e79f-4828-9088-a6068a13273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:33.123474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 742/1487] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:33.127284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.242760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2178d-0d66-4c16-923c-c3c7d5f2d58e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:33.254292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:33.255757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.256427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.257098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.258592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:33.261947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0b6cd-3315-42ea-b744-1a4ea183f5d9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:33.332395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 746/1488] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:33 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:33.336440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fff34-e79f-4828-9088-a6068a13273b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.368172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fff34-e79f-4828-9088-a6068a13273b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:33.497813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:33.499267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.499576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.499850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.500523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:33.511573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:33.512742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97259ba-b9c1-4736-8174-ff62032c03f1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.513738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97259ba-b9c1-4736-8174-ff62032c03f1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.514434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97259ba-b9c1-4736-8174-ff62032c03f1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.517453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 747/1489] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:42:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:42:33.572192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.572192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.572356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.590872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 743/1490] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:33 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:33.595803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.635732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:33.637371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc47146-effc-4bd7-a4c5-77ebfe089267 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:33.639889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:33.661771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:33.662396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.662690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.662963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.663682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:33.674165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:33.720521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 744/1491] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:33.723306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.744399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:33.751351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba23e6-a669-4ec0-8552-9efb7e03ab31 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:33.763115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:33.764302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:33.766728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:33.767757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] PATH_INFO: `/v3/projects/d318f6c84d5f437588aadbbc5b120cc3/users/4ceb9eedf9cb4567a8f35e1a8320b11a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:33.802339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 748/1492] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:42:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:33.813597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d318f6c84d5f437588aadbbc5b120cc3, user_id=4ceb9eedf9cb4567a8f35e1a8320b11a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:33.817782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:33.844201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 745/1493] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:33 2022] PUT /identity/v3/projects/d318f6c84d5f437588aadbbc5b120cc3/users/4ceb9eedf9cb4567a8f35e1a8320b11a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:33.848592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.870976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:33.875245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:33.877731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1d620-897b-4910-8c61-a9dcb6187b58 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.069696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.070348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.070646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.070924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.072435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.073792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.110043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 749/1494] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:34.111211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:34.114833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c12c-fe54-4ba6-9135-29f7073796df admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.124406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:34.136452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938474-d753-4b83-8b54-af91762392a7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.137768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.138950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.139390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.139844 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.146726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.147434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.147756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.148033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] PATH_INFO: `/v3/projects/d318f6c84d5f437588aadbbc5b120cc3/users/4ceb9eedf9cb4567a8f35e1a8320b11a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.152235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d318f6c84d5f437588aadbbc5b120cc3, user_id=4ceb9eedf9cb4567a8f35e1a8320b11a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.153574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.156131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e236b-d19a-421a-962f-a3444e135089 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.156350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.182519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 750/1495] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:34 2022] PUT /identity/v3/projects/d318f6c84d5f437588aadbbc5b120cc3/users/4ceb9eedf9cb4567a8f35e1a8320b11a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:34.183742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:34.185534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:34.190410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 746/1496] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:34.192714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.193655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.193938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.292960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] MFA Rules not processed for user `4ceb9eedf9cb4567a8f35e1a8320b11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:34.294244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:34.322484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234679cd-6213-4a65-901a-920140694d2b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.329857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.330684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.330858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.331122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] PATH_INFO: `/v3/projects/f9af1c4178264782a051d9eb3c21c8f5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.332330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9af1c4178264782a051d9eb3c21c8f5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.335115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.472784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9af1c4178264782a051d9eb3c21c8f5', 'request_id': 'req-8251ced0-206a-4e2b-b61d-83d8e3f480b5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.492759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9af1c4178264782a051d9eb3c21c8f5', 'request_id': 'req-8251ced0-206a-4e2b-b61d-83d8e3f480b5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.501860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9af1c4178264782a051d9eb3c21c8f5', 'request_id': 'req-8251ced0-206a-4e2b-b61d-83d8e3f480b5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.529252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] The token cache is being invalidate because project f9af1c4178264782a051d9eb3c21c8f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:34.530333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.531708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.533883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 751/1497] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:34 2022] DELETE /identity/v3/projects/f9af1c4178264782a051d9eb3c21c8f5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:34.537276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 747/1498] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:34.539413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:34.540584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:34.542427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:34.604443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ea3ca-8224-4ae6-8127-45c459537507 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.652403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251ced0-206a-4e2b-b61d-83d8e3f480b5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:34.657456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.658397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.658783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.659298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.661887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:34.729484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:34.748604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:34.748691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:34.749081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:34.752420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:34.752420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] PATH_INFO: `/v3/users/b01d5744295043cfb938d9513f5a37f4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:34.753605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01d5744295043cfb938d9513f5a37f4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.755417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.813582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:34.815427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:34.836234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 752/1499] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:34.837732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01d5744295043cfb938d9513f5a37f4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.838701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01d5744295043cfb938d9513f5a37f4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.850584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01d5744295043cfb938d9513f5a37f4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.878254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01d5744295043cfb938d9513f5a37f4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.896837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01d5744295043cfb938d9513f5a37f4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:34.909478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 748/1500] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:34 2022] DELETE /identity/v3/users/b01d5744295043cfb938d9513f5a37f4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:35.509564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:35.511274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:35.530045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36caf72-9fe1-444a-a393-39ef1cd84193 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:35.652888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:35.653863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:35.654282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:35.654690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:35.659977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:35.852747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:35.854481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60d303-9344-4bc8-8371-ded13933e9bd service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:35.866805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 753/1501] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:36.438899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:36.442162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:36.619140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934e6c-60bb-4961-84ad-dd4d23124ca2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:36.625465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:36.626119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:36.626396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:36.626692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] PATH_INFO: `/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:36.627843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f43a6e7cb7848e1ac3b88e4cfaecd8d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:36.629812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:36.698683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f43a6e7cb7848e1ac3b88e4cfaecd8d', 'request_id': 'req-43a6627b-e73e-40f4-9e89-b7f55b8b622d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:36.711619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f43a6e7cb7848e1ac3b88e4cfaecd8d', 'request_id': 'req-43a6627b-e73e-40f4-9e89-b7f55b8b622d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:36.720570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f43a6e7cb7848e1ac3b88e4cfaecd8d', 'request_id': 'req-43a6627b-e73e-40f4-9e89-b7f55b8b622d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:36.735970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:36.741781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] The token cache is being invalidate because project 5f43a6e7cb7848e1ac3b88e4cfaecd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:36.742811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:36.743807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43a6627b-e73e-40f4-9e89-b7f55b8b622d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:36.751252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 749/1502] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:36 2022] DELETE /identity/v3/projects/5f43a6e7cb7848e1ac3b88e4cfaecd8d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:36.752637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:36.753405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:36.753405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:36.783298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:36.785166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:36.900859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 754/1503] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:36.907519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:36.907993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:36.908331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:36.997118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:36.999719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:37.031011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 750/1504] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:37.031793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.046912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefd21c-68d5-46a9-842c-130515ade41d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.052713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.053602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.057622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.057907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.058596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:37.058903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.068313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.090028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 755/1505] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:37.094285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.106224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0e6e6-cc0e-45cb-82f4-14d7daaf6ec7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.111957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.112577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.112852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.113170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.120886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.123682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.157327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 751/1506] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:37 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:37.161540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.174780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a240f-0218-44a9-b6c4-df4d8938d520 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.183703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:37.252229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.253464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.254986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.255498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.256504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.259773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.293374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 756/1507] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:37 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:37.295167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.308104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716993be-8efc-4a29-a913-47e7ef40297d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.313901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.314936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.315385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.315867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.316576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.318555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.331475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 752/1508] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:37.337039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.347809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc6c9-1602-4200-9597-b5e095c57470 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.352932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.353791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.354134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.354473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.355213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.356986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b336716-f30a-422c-9c83-66f03301603f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.372125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 757/1509] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:37.373861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.385879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4b1d-bd05-4993-bbf2-d35c7d57f607 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.390757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.391411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.391697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.391942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] PATH_INFO: `/v3/projects/6816d1ac50e3464da0ec76f1e2dc0062/users/f38f26121a154e858e2ebe3739667589/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.414048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6816d1ac50e3464da0ec76f1e2dc0062, user_id=f38f26121a154e858e2ebe3739667589, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.416858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.445653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 753/1510] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:37 2022] PUT /identity/v3/projects/6816d1ac50e3464da0ec76f1e2dc0062/users/f38f26121a154e858e2ebe3739667589/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:37.460469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.461038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.461502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.515204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] MFA Rules not processed for user `f38f26121a154e858e2ebe3739667589`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:37.516483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:37.627450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 758/1511] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:37.628325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.728366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e92ccc-aec4-45c6-9912-33449d9d07f9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.734202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.735130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.735519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.735928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.737378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.739948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.794854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 754/1512] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:37 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:37.797966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:37.815351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53694e6-9ec3-4473-a95c-f820fa4dcb56 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:37.938294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:37.938928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:37.939383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:37.939790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:37.940583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:37.942762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:37.986325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 759/1513] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:37 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:37.990681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.008799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3f62a-ed3d-4ce0-89ea-a2e437862cb5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.023375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.024213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.027002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.027268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.027943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.033909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.069444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 755/1514] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:38.074373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.086553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fa7b-7e17-4797-a1cc-cc5bf9eadb9f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.095871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.096876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.097261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.097534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] PATH_INFO: `/v3/projects/c0ae445025394c629f8b2ae4e20864a3/users/e5b10133c68e4fae9657cf34d5a6dcdc/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.102610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.121324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ae445025394c629f8b2ae4e20864a3, user_id=e5b10133c68e4fae9657cf34d5a6dcdc, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.124649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.148386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 760/1515] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:38 2022] PUT /identity/v3/projects/c0ae445025394c629f8b2ae4e20864a3/users/e5b10133c68e4fae9657cf34d5a6dcdc/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:38.152495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.165615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06b062-0e94-45b9-af8d-a330afab0dde admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.192892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.195021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.237042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.237963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.238233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.238653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.239366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.241026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.251575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 756/1516] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:38.255926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.257658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.271229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76107748-55e0-4e75-a781-9384db1ede4b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.273122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde905-9127-4e83-9a15-ba752dc34d93 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.278275 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.279364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.279839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.280196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.280490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] PATH_INFO: `/v3/users/c48b25976bbd4864a2c437d32bad3042` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.281775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.282264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.282597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] PATH_INFO: `/v3/users/fc7de4650e254dee872a679b047f9914` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.282822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48b25976bbd4864a2c437d32bad3042)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.284045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7de4650e254dee872a679b047f9914)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.285459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.287104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.288300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.351982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48b25976bbd4864a2c437d32bad3042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.352143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7de4650e254dee872a679b047f9914'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.352875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48b25976bbd4864a2c437d32bad3042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.361361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7de4650e254dee872a679b047f9914'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.363988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48b25976bbd4864a2c437d32bad3042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.374355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7de4650e254dee872a679b047f9914'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.375027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7de4650e254dee872a679b047f9914'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.378072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48b25976bbd4864a2c437d32bad3042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.382607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7de4650e254dee872a679b047f9914'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.386743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73fc4500-ccf4-41df-baa4-f762a01eb5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48b25976bbd4864a2c437d32bad3042'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.388868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 761/1517] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:38 2022] DELETE /identity/v3/users/fc7de4650e254dee872a679b047f9914 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:38.389500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.390949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.396337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 757/1518] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:38 2022] DELETE /identity/v3/users/c48b25976bbd4864a2c437d32bad3042 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:38.396337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150891ed-044d-44fe-8075-674c553b80d4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.396337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150891ed-044d-44fe-8075-674c553b80d4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.396337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150891ed-044d-44fe-8075-674c553b80d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.416929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-150891ed-044d-44fe-8075-674c553b80d4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:38.418238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-150891ed-044d-44fe-8075-674c553b80d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.472074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41929c24-e379-4d81-b2da-116dc4f9b511 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.480732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.485598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 758/1519] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:38.486876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.487184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.487460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.512445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:38.513700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.526748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 759/1520] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:38.526748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.529398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.552694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.553614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.553977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.554312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] PATH_INFO: `/v3/projects/c0ae445025394c629f8b2ae4e20864a3/users/e5b10133c68e4fae9657cf34d5a6dcdc/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.556675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ae445025394c629f8b2ae4e20864a3, user_id=e5b10133c68e4fae9657cf34d5a6dcdc, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.559890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.574158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 762/1521] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:38 2022] PUT /identity/v3/projects/c0ae445025394c629f8b2ae4e20864a3/users/e5b10133c68e4fae9657cf34d5a6dcdc/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:38.584711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.587171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.632704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0d560-d447-437a-8887-67685ff7b922 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.668097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.670078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96d7d-2963-480b-b9eb-e14a6ab182a4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.673813 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.674498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.674770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.675245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.701077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.701760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.702037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.702334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.744170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.745881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc8a5-872f-4ce2-86cc-8abdf901b693 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.756460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 763/1522] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:38.758178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.758538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.758798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.780417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.781972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.788191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] MFA Rules not processed for user `e5b10133c68e4fae9657cf34d5a6dcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:38.789811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.792977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 760/1523] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:38.845810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:38.859802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.861657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.879267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff62b9-3a53-4fc0-ac3c-f565677cb3b8 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.880474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 764/1524] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:38.885488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.886541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.887065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.887455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] PATH_INFO: `/v3/users/a2634a4aa11943948380861e105c4e92` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.888958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2634a4aa11943948380861e105c4e92)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.891172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.895129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:38.897457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:38.948371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2634a4aa11943948380861e105c4e92'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.949717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2634a4aa11943948380861e105c4e92'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.958677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2634a4aa11943948380861e105c4e92'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.965476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89019818-21e4-40b9-9143-fb577d10e196 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:38.969274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:38.969903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:38.970216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:38.970446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:38.977972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2634a4aa11943948380861e105c4e92'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.983823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:38.985299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc1282-22e7-4efa-8217-cc39abc47c8b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:38.991821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2634a4aa11943948380861e105c4e92'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:38.995880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 765/1525] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:39.000928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 761/1526] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:38 2022] DELETE /identity/v3/users/a2634a4aa11943948380861e105c4e92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:39.005798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.006305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.007109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.052311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:39.054466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.179686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.181911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.201240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 766/1527] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:39.245329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.247424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.265114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00508e47-43be-4d42-8530-6edb0a7d58e3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.274600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:39.275718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.276190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.276705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.279018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.303139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:39.354365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac3aa1-7d47-4966-94fc-1246d4715406 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.359240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:39.360222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.360833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.361455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.373278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:39.374949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:39.392268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 767/1528] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:39.393513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.395609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.420037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c729ae-475a-4fc2-992b-6f3a0b4fe47c service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.438110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:39.441228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.441684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.443142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] PATH_INFO: `/v3/projects/082e394b7e8942f98018c44625fc50e2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.444629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=082e394b7e8942f98018c44625fc50e2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:39.447552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:39.449751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:39.449993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:39.485505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 762/1529] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:39.495746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:39.536332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082e394b7e8942f98018c44625fc50e2', 'request_id': 'req-65b024dd-ae83-49bd-a228-e7be9acf4b3d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.550117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082e394b7e8942f98018c44625fc50e2', 'request_id': 'req-65b024dd-ae83-49bd-a228-e7be9acf4b3d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.562677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082e394b7e8942f98018c44625fc50e2', 'request_id': 'req-65b024dd-ae83-49bd-a228-e7be9acf4b3d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.583316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] The token cache is being invalidate because project 082e394b7e8942f98018c44625fc50e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:39.583927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.584578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.586162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 768/1530] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:39 2022] DELETE /identity/v3/projects/082e394b7e8942f98018c44625fc50e2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:39.590928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.597465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.600198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.606065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a5584-f908-4145-8da7-4b1b28ed316f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.699669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:39.700779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.701109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.701597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] PATH_INFO: `/v3/users/4ceb9eedf9cb4567a8f35e1a8320b11a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.703403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ceb9eedf9cb4567a8f35e1a8320b11a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:39.707161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:39.730116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b024dd-ae83-49bd-a228-e7be9acf4b3d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.735458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:39.736377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:39.736753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:39.737304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] PATH_INFO: `/v3/projects/dc5e7c0eb99d4a8cb6c8442b3ce7312c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:39.739166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5e7c0eb99d4a8cb6c8442b3ce7312c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:39.741256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:39.802421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5e7c0eb99d4a8cb6c8442b3ce7312c', 'request_id': 'req-77603bff-81ba-4153-9533-a10861e424da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.807613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ceb9eedf9cb4567a8f35e1a8320b11a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.808427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ceb9eedf9cb4567a8f35e1a8320b11a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.813459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5e7c0eb99d4a8cb6c8442b3ce7312c', 'request_id': 'req-77603bff-81ba-4153-9533-a10861e424da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.818402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ceb9eedf9cb4567a8f35e1a8320b11a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.827608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5e7c0eb99d4a8cb6c8442b3ce7312c', 'request_id': 'req-77603bff-81ba-4153-9533-a10861e424da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.838465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ceb9eedf9cb4567a8f35e1a8320b11a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.847563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ceb9eedf9cb4567a8f35e1a8320b11a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.853524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] The token cache is being invalidate because project dc5e7c0eb99d4a8cb6c8442b3ce7312c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:39.854076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.855104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:39.857288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 769/1531] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:39 2022] DELETE /identity/v3/projects/dc5e7c0eb99d4a8cb6c8442b3ce7312c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:39.857823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 763/1532] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:39 2022] DELETE /identity/v3/users/4ceb9eedf9cb4567a8f35e1a8320b11a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:39.863904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.865682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.926154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:39.938928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:39.940592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:39.970935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603bff-81ba-4153-9533-a10861e424da admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:39.996077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:40.056024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170078-c001-43c0-84f6-41956afe1fa8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:40.060792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.061303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.061576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.061846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] PATH_INFO: `/v3/projects/078d50800fa4464e87e7609a292e173a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.063027 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078d50800fa4464e87e7609a292e173a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.067860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.083214 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.084290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.084963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.084963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] PATH_INFO: `/v3/users/aff021bb5acc444fb21722d0ea7755b7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.088587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff021bb5acc444fb21722d0ea7755b7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.090694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.148246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff021bb5acc444fb21722d0ea7755b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.150362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078d50800fa4464e87e7609a292e173a', 'request_id': 'req-28f1d4b4-f812-41d9-8470-9243c46f7407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.157103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff021bb5acc444fb21722d0ea7755b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.160259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078d50800fa4464e87e7609a292e173a', 'request_id': 'req-28f1d4b4-f812-41d9-8470-9243c46f7407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.167473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078d50800fa4464e87e7609a292e173a', 'request_id': 'req-28f1d4b4-f812-41d9-8470-9243c46f7407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.172153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff021bb5acc444fb21722d0ea7755b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.173061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff021bb5acc444fb21722d0ea7755b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.178314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] The token cache is being invalidate because project 078d50800fa4464e87e7609a292e173a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:40.178595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.179278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.180814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 764/1533] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:39 2022] DELETE /identity/v3/projects/078d50800fa4464e87e7609a292e173a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:40.181596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff021bb5acc444fb21722d0ea7755b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.184856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:40.186241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.191769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 770/1534] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:39 2022] DELETE /identity/v3/users/aff021bb5acc444fb21722d0ea7755b7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:40.233479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:40.234927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.268313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d4b4-f812-41d9-8470-9243c46f7407 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:40.315224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f240a0-e9f4-45de-9d90-7c08ded05c3c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:40.320876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.321708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.322041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.322421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] PATH_INFO: `/v3/projects/d318f6c84d5f437588aadbbc5b120cc3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.323608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d318f6c84d5f437588aadbbc5b120cc3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.326130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.335170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:40.356940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.357620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.357896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.358166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] PATH_INFO: `/v3/users/dd6dedfbaa504d87bf311e3c38b16e30` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.359456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6dedfbaa504d87bf311e3c38b16e30)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.362260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.365962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:40.389070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd318f6c84d5f437588aadbbc5b120cc3', 'request_id': 'req-758654fb-f803-4baf-a8db-5a7adc491fa5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.399919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd318f6c84d5f437588aadbbc5b120cc3', 'request_id': 'req-758654fb-f803-4baf-a8db-5a7adc491fa5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.407196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd318f6c84d5f437588aadbbc5b120cc3', 'request_id': 'req-758654fb-f803-4baf-a8db-5a7adc491fa5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.422005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6dedfbaa504d87bf311e3c38b16e30'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.422372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] The token cache is being invalidate because project d318f6c84d5f437588aadbbc5b120cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:40.422876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.422989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6dedfbaa504d87bf311e3c38b16e30'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.423537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-758654fb-f803-4baf-a8db-5a7adc491fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.425361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 771/1535] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:40 2022] DELETE /identity/v3/projects/d318f6c84d5f437588aadbbc5b120cc3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:40.430086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f220-0f02-4a0f-a0e5-7b09698f9e91 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.430365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f220-0f02-4a0f-a0e5-7b09698f9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.430636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048f220-0f02-4a0f-a0e5-7b09698f9e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.431837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6dedfbaa504d87bf311e3c38b16e30'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.452068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c048f220-0f02-4a0f-a0e5-7b09698f9e91 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:40.453336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c048f220-0f02-4a0f-a0e5-7b09698f9e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.455438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6dedfbaa504d87bf311e3c38b16e30'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.463380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6dedfbaa504d87bf311e3c38b16e30'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.475698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 765/1536] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:40 2022] DELETE /identity/v3/users/dd6dedfbaa504d87bf311e3c38b16e30 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:40.533633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:40.536188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.558124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 772/1537] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:40.567069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.567406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.568068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.626992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:40.628777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.697827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234c633-ed40-4759-bc78-00039b2e3e75 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:40.706615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.707421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.709465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.709465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] PATH_INFO: `/v3/projects/5e5e73a78dfb4b788271ee179d1118b4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.712422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5e73a78dfb4b788271ee179d1118b4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.714253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.778494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 773/1538] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:40.790285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:40.795755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5e73a78dfb4b788271ee179d1118b4', 'request_id': 'req-f834849a-e5d2-4249-baad-078d7053e041'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.814697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1657-ba30-469e-964a-59bd7232eb32 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:40.826445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5e73a78dfb4b788271ee179d1118b4', 'request_id': 'req-f834849a-e5d2-4249-baad-078d7053e041'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.849470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5e73a78dfb4b788271ee179d1118b4', 'request_id': 'req-f834849a-e5d2-4249-baad-078d7053e041'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.896428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] The token cache is being invalidate because project 5e5e73a78dfb4b788271ee179d1118b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:40.897098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.897200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:40.898683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f834849a-e5d2-4249-baad-078d7053e041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:40.904154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 766/1539] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:40 2022] DELETE /identity/v3/projects/5e5e73a78dfb4b788271ee179d1118b4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:40.905462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbffe-eea2-4e49-9d15-8da8800a1c4d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.905598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbffe-eea2-4e49-9d15-8da8800a1c4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.905855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbbffe-eea2-4e49-9d15-8da8800a1c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.930531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-91cbbffe-eea2-4e49-9d15-8da8800a1c4d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:40.931757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-91cbbffe-eea2-4e49-9d15-8da8800a1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:40.952139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:40.954030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:40.954526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:40.954800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:40.955142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:40.955847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:40.956149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:40.957857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:40.980699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 774/1540] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:40.985123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:40.988948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.021245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781b6f-25fe-425b-9616-bad9541894c2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.027935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.028775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.029255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.029527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.030182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.032344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.049520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 767/1541] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:41.065077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.065077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.065077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.093173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:41.094957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.117733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 775/1542] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:40 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:41.118772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.140591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 768/1543] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:41.140591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.148256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.163914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391ac2b-0c7e-4fe8-bfbc-f91b11a1d4f7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.272088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21f744-e333-4296-af78-24ab0ae74dd9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.282978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.283960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.284401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.284615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.285473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.287873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.295312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.295955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.296227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.296667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] PATH_INFO: `/v3/projects/042e2e86c7e9407c82f111add37b1d4a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.297900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042e2e86c7e9407c82f111add37b1d4a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.300173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.317116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 776/1544] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:41.317116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.326061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd0448-5ef6-4530-94e9-03c4b19680d1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.331884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.333712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.333880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.334157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.334806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:41.335149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.337210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.350323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 777/1545] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:41.351232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.359150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042e2e86c7e9407c82f111add37b1d4a', 'request_id': 'req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.361863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309ec2-f48c-4c87-b77b-ebf130dcf8bb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.370536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042e2e86c7e9407c82f111add37b1d4a', 'request_id': 'req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.378112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042e2e86c7e9407c82f111add37b1d4a', 'request_id': 'req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.390915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] The token cache is being invalidate because project 042e2e86c7e9407c82f111add37b1d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:41.391259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.391959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.393524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 769/1546] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:41 2022] DELETE /identity/v3/projects/042e2e86c7e9407c82f111add37b1d4a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:41.394251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.395894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.436477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.437137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.437413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.437679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.438335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.439956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.446751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:41.450961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 778/1547] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:41.451780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.453459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.466378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2459a1-058e-420a-818f-efd29372934c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.470909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.471588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.471855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.472062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] PATH_INFO: `/v3/users/58699ae4db4d44478971a60836c982be` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.473326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58699ae4db4d44478971a60836c982be)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.475599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.476612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d0ad3-32b4-48ff-ad46-ad514bd7acb4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.481517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.482132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.482407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.482679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.483434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.485445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.494144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:41.520191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 770/1548] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:41.520191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.520191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.531219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58699ae4db4d44478971a60836c982be'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.538589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58699ae4db4d44478971a60836c982be'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.551785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58699ae4db4d44478971a60836c982be'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.552509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58699ae4db4d44478971a60836c982be'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.572124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58699ae4db4d44478971a60836c982be'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:41.579188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 779/1549] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:41 2022] DELETE /identity/v3/users/58699ae4db4d44478971a60836c982be => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:41.580042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.581918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.588060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba1a4-a9dc-4e73-93f2-d6733b960c37 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.666555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.667142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.667411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.667673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.668330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.671025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.687596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 771/1550] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:41.691814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.693834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.708048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda037d9-36b0-4026-a7a4-31ed7d1fab92 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.714238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.714762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.715036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.715600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] PATH_INFO: `/v3/projects/3f43bfb2566a410a924790b29830a09c/users/bfc6baf082684db3a3d09f215e422772/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.733265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f43bfb2566a410a924790b29830a09c, user_id=bfc6baf082684db3a3d09f215e422772, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.736301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b724d-9a01-4238-b914-e21cbd1f7e31 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.755663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 772/1551] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:41 2022] PUT /identity/v3/projects/3f43bfb2566a410a924790b29830a09c/users/bfc6baf082684db3a3d09f215e422772/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:41.765990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.766272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.766545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.795732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] MFA Rules not processed for user `bfc6baf082684db3a3d09f215e422772`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:41.796448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f783c-331e-48b6-aaa3-3f9006d60fe1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.797229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.832049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:41.867778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.868477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.868843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.869199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.870023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.872432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.899161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 773/1552] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:41.899969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.901322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:41.905257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 780/1553] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:41.910256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.923138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca32720-02ab-4ee0-bcfe-1052d26356fe admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.928400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.929722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.930097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.930461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.934105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.936139 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.942882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec52df3-73b2-4213-961d-25349995e0dd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:41.955090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:41.956334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:41.956334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:41.956768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] PATH_INFO: `/v3/projects/e80054bdc1de44ff933d004a134206a3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:41.959229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80054bdc1de44ff933d004a134206a3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:41.960682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:41.978852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 781/1554] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:41 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:41.980180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:41.992696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:42.031941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80054bdc1de44ff933d004a134206a3', 'request_id': 'req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.044042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80054bdc1de44ff933d004a134206a3', 'request_id': 'req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.052429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80054bdc1de44ff933d004a134206a3', 'request_id': 'req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.083682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] The token cache is being invalidate because project e80054bdc1de44ff933d004a134206a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:42.083682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.084322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.087194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 774/1555] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:41 2022] DELETE /identity/v3/projects/e80054bdc1de44ff933d004a134206a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:42.088456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.089895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.094768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc2d8-d91c-46a1-9f04-4b1093553e50 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.174394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.175677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.176193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cfe1-7d78-458e-86a9-c12a0bfa1204 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.176413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.177096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.178699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.181456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d3753-b0c0-4dff-bdbf-8ce209710a78 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.181667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.182249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.182529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.182805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.183436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.185380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.196111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 782/1556] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:42.198631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.199106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.199633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.224710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 775/1557] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:42.225209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:42.226325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.226800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.228178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.241335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 783/1558] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:42.242555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.251474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073d9a-8e49-4858-875d-5980afb8b6dd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.255844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571e9f-8de4-426e-8945-c46e658dfcfc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.255991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.256627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.256989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.257295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.257968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.259922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de670cff-723e-49db-85c8-5fb3edbe149c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.262591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.263208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.263486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.263793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.264423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.266086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.271748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 776/1559] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:42.273257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.273983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.274225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.277039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 784/1560] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:42.281151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.292533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7916-8c24-4abb-8782-2be7aefbe792 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.298890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.300213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.300493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.300788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] PATH_INFO: `/v3/projects/59b532dce1b94bce8fe1850f939569a4/users/1793d1376f654e58851d36f70f8fe602/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.302217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:42.303417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.314878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 777/1561] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:42.317028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.326805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b532dce1b94bce8fe1850f939569a4, user_id=1793d1376f654e58851d36f70f8fe602, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.327673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc522e19-fcab-4a74-83f9-696ed34d3ac0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.331516 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.334286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.335207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.335641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.336048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] PATH_INFO: `/v3/projects/6a910413f77549d292cffcc1cddbcb8f/users/cea03f0f83964506b3380859e9e239b9/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.349937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 785/1562] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:42 2022] PUT /identity/v3/projects/59b532dce1b94bce8fe1850f939569a4/users/1793d1376f654e58851d36f70f8fe602/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:42.359641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.368588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a910413f77549d292cffcc1cddbcb8f, user_id=cea03f0f83964506b3380859e9e239b9, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.371705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d99a46-885b-4717-b365-d0c9a28f3bec admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.388957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:42.403634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 778/1563] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:42 2022] PUT /identity/v3/projects/6a910413f77549d292cffcc1cddbcb8f/users/cea03f0f83964506b3380859e9e239b9/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:42.405272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.405885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.406790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.426635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aad03-3922-4d46-b8b8-a6aa91735979 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.444240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:42.448715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] MFA Rules not processed for user `1793d1376f654e58851d36f70f8fe602`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:42.450629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.498275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.498897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.499169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.499848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.500493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:42.500792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.502433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.515073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 786/1564] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:42.516022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.525877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53b5f6-5e8e-468b-9032-bbcbb3fb3f53 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.530339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 779/1565] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:42.530605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.531223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.531331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.531601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.531866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.532609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.534250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.534590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.545309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 787/1566] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:42.546140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.547605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1639-a1a6-4435-a741-e82b814fa08a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.552264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.552931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.553253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.553524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] PATH_INFO: `/v3/users/f38f26121a154e858e2ebe3739667589` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.554711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38f26121a154e858e2ebe3739667589)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.556033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b6235-76e2-4fe7-8f16-498b240c8a80 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.556653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.565851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.566512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.566836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.567137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.567854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.569839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.599228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 788/1567] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:42.602115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.612128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38f26121a154e858e2ebe3739667589'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.612848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38f26121a154e858e2ebe3739667589'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.623094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38f26121a154e858e2ebe3739667589'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.642763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38f26121a154e858e2ebe3739667589'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.655519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38f26121a154e858e2ebe3739667589'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:42.664141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 780/1568] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:42 2022] DELETE /identity/v3/users/f38f26121a154e858e2ebe3739667589 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:42.664936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.666602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.685531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a07f04-7e61-4c59-b3ed-d8ec46266810 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.752026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c82576-c0aa-46ae-aabb-8201003c5e74 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.753178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.753899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.754448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.754640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.755363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.758556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.758715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bc07b-515f-4eeb-8f47-a89e21eda41a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.759373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.759712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.760048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] PATH_INFO: `/v3/projects/6a910413f77549d292cffcc1cddbcb8f/users/cea03f0f83964506b3380859e9e239b9/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.762172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a910413f77549d292cffcc1cddbcb8f, user_id=cea03f0f83964506b3380859e9e239b9, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.766031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.770653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:42.780319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 781/1569] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:42 2022] PUT /identity/v3/projects/6a910413f77549d292cffcc1cddbcb8f/users/cea03f0f83964506b3380859e9e239b9/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:42.782257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.784062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.803387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 789/1570] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:42.804780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3a0a-0e1e-4d8a-bcd3-e56561bc980d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.805086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3a0a-0e1e-4d8a-bcd3-e56561bc980d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.805359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3a0a-0e1e-4d8a-bcd3-e56561bc980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.825414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c2cc3a0a-0e1e-4d8a-bcd3-e56561bc980d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:42.826685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c2cc3a0a-0e1e-4d8a-bcd3-e56561bc980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.832221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:42.871683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd1bb6-f4ee-45fe-8a1b-d5a71d5378eb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.894550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 790/1571] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:42.896218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.896495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.896758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.926929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] MFA Rules not processed for user `cea03f0f83964506b3380859e9e239b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:42.928167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.942991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.943273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.943393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.943706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.944865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:42.946876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:42.973661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 782/1572] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:42.977386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:42.979310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:42.991104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf8bc2-1ce4-4b93-a510-7e056d8f6dcd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:42.996269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:42.996945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:42.997335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:42.997700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:42.998436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.000420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.013178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 791/1573] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:43.014346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.016439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.025725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 783/1574] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:42 2022] POST /identity/v3/users => generated 295 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:43.026409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.035886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139628b-d19a-40ae-9db4-f1cf647f7736 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.040492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.041120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.041394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.041654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.042287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.043889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.054654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 784/1575] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:43.058188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.059930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.078809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95194a-6e30-4840-829c-cfc6e7fc6fb7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.083099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.083711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.083981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.084239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.094896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.096313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.106980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 792/1576] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:43.107599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.117961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc673a-1d3c-4f22-b973-12b8b2ac02d6 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.120748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2b1f-8a7e-4b79-906d-f0d74e5871e0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.122706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.123319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.123573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.123838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.124479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.124592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.125129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.125418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.125681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.126349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.127449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.136980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 793/1577] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:43.140963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.148719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:43.160647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626e2de-e46e-4feb-a535-6a475506512a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.166985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.167621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.167895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.168398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.169308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.170912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.187221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 794/1578] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:43.187221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.198590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0e948-8299-4cab-b104-fb77154cc134 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.199320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.201505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.205715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.207087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.207467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.207783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] PATH_INFO: `/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c/users/e29b0684049e40fab2a7beb8a61cc90e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.213804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 785/1579] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:43.214570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.228020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e272-55bd-49e7-a68a-3096bcc0e9de service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.233899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d623ee4e3f245438cc5f895a01b6e7c, user_id=e29b0684049e40fab2a7beb8a61cc90e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.234174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.234865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.235370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.235688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] PATH_INFO: `/v3/projects/28e8b09d9f184169acc347bfb950f22d/users/2cd6c067ae804f7e9fa116b3c589a429/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.237115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.241484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:43.258538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e8b09d9f184169acc347bfb950f22d, user_id=2cd6c067ae804f7e9fa116b3c589a429, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.259834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 795/1580] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:43 2022] PUT /identity/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c/users/e29b0684049e40fab2a7beb8a61cc90e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:43.261684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83f8a-becf-4a29-80b0-6fdc32165c4c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.263687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.285495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 786/1581] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:43 2022] PUT /identity/v3/projects/28e8b09d9f184169acc347bfb950f22d/users/2cd6c067ae804f7e9fa116b3c589a429/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:43.298259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.298588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.298908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.358681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] MFA Rules not processed for user `2cd6c067ae804f7e9fa116b3c589a429`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:43.359917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.374315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14060717-651a-46b4-b5fe-de1b828db6d7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.494529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.495212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.495482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.495750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.496748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.500360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.515811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 787/1582] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:43.523010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.528210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 796/1583] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:42:43.533329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.553971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375a00-8117-4898-9079-ece584883329 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.563909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ead94-f463-4753-ae0d-18e483b089cd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.570730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.572600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.573385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.574438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] PATH_INFO: `/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c/users/e29b0684049e40fab2a7beb8a61cc90e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.581023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d623ee4e3f245438cc5f895a01b6e7c, user_id=e29b0684049e40fab2a7beb8a61cc90e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.585236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.586266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.589390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a2f4-87f2-4ef6-a859-15e14ace2203 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.589897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.590397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.593384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.597348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.646523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 797/1584] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:43 2022] PUT /identity/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c/users/e29b0684049e40fab2a7beb8a61cc90e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:43.649724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539c9e-e721-4289-a754-61b779e579dd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.650051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539c9e-e721-4289-a754-61b779e579dd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.650322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539c9e-e721-4289-a754-61b779e579dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.697296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 788/1585] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:42:43.697296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.751915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-58539c9e-e721-4289-a754-61b779e579dd None None] MFA Rules not processed for user `e29b0684049e40fab2a7beb8a61cc90e`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:43.753215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-58539c9e-e721-4289-a754-61b779e579dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.835473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018196fa-ce6c-4ccf-bc8a-c8026aeca6eb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.842208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.842841 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.843313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.843539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.845094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.847101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.860215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:43.879019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 789/1586] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:43 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:43.880069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.882242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:43.895812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8571e-744e-4fca-b562-1576a5589977 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.902080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.902726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.903005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.903272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] PATH_INFO: `/v3/projects/6816d1ac50e3464da0ec76f1e2dc0062` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.904433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6816d1ac50e3464da0ec76f1e2dc0062)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.906399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.911260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 798/1587] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:43.911930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539c9e-e721-4289-a754-61b779e579dd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.937960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539c9e-e721-4289-a754-61b779e579dd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:43.944920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:43.945661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:43.945936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:43.946283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:43.946915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:43.949125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:43.951929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:43.963624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 799/1588] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:43.964646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:43.972832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6816d1ac50e3464da0ec76f1e2dc0062', 'request_id': 'req-4fec0736-afc5-4850-9220-700636592485'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:43.983425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6816d1ac50e3464da0ec76f1e2dc0062', 'request_id': 'req-4fec0736-afc5-4850-9220-700636592485'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:43.992895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6816d1ac50e3464da0ec76f1e2dc0062', 'request_id': 'req-4fec0736-afc5-4850-9220-700636592485'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.006348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] The token cache is being invalidate because project 6816d1ac50e3464da0ec76f1e2dc0062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:44.006631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.007396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.008915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 790/1589] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:43 2022] DELETE /identity/v3/projects/6816d1ac50e3464da0ec76f1e2dc0062 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:44.009674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.011086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.029176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c447a2f-d8e2-4530-840d-91ea2caacc4f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.081093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0736-afc5-4850-9220-700636592485 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.085754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.086139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.086372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.086645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.086838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.086926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.087111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.087447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] PATH_INFO: `/v3/projects/78fe8aeecfa54e209338f233ed52c0ab/users/58b88f6e4e8f4758b59a5d7e90065963/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.088744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.102244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fe8aeecfa54e209338f233ed52c0ab, user_id=58b88f6e4e8f4758b59a5d7e90065963, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.104907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.118878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 791/1590] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:44 2022] PUT /identity/v3/projects/78fe8aeecfa54e209338f233ed52c0ab/users/58b88f6e4e8f4758b59a5d7e90065963/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:44.119807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.121549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.152898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.154509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.164348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 800/1591] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:44.165210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.166478 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.179556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a919d-146f-49af-bc2b-204c01f3c9a1 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.182638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:44.185802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.186171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.186443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.186710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] PATH_INFO: `/v3/users/d757b35af4cd4ed08e063b984426e0d6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.186812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5c9c0-604c-41df-bc86-80ad9aaa1e2f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.188020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d757b35af4cd4ed08e063b984426e0d6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.190205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.194928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.195587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.196232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.196850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] PATH_INFO: `/v3/users/e5b10133c68e4fae9657cf34d5a6dcdc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.198206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b10133c68e4fae9657cf34d5a6dcdc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.206957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.256217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd757b35af4cd4ed08e063b984426e0d6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.263835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b10133c68e4fae9657cf34d5a6dcdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.264612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b10133c68e4fae9657cf34d5a6dcdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.264771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd757b35af4cd4ed08e063b984426e0d6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.270394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:44.274778 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b10133c68e4fae9657cf34d5a6dcdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.296562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b10133c68e4fae9657cf34d5a6dcdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.297116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd757b35af4cd4ed08e063b984426e0d6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.298352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd757b35af4cd4ed08e063b984426e0d6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.305242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b10133c68e4fae9657cf34d5a6dcdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.308191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f3b0ebc-c27f-41d6-b2b2-81fb8e878774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd757b35af4cd4ed08e063b984426e0d6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.313273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 792/1592] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:44 2022] DELETE /identity/v3/users/e5b10133c68e4fae9657cf34d5a6dcdc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:44.314367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.315725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.321028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 801/1593] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:44 2022] DELETE /identity/v3/users/d757b35af4cd4ed08e063b984426e0d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:44.325691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.326061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.326335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.365983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:44.367282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.440278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226b31-7d6f-42a9-8adc-45f706384543 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.458210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 802/1594] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:44.469372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.470992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.545943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.547344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.547788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.548583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.549707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.552118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.566462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 793/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:44.567106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb27a9-3bc6-488f-89c4-7be8dca3bb81 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.572222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.575436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.577314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.585507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.586125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.586772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa919823-34c0-40bf-b9a0-25f4498a5471 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.592322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.593296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.593745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.594186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] PATH_INFO: `/v3/projects/78fe8aeecfa54e209338f233ed52c0ab/users/58b88f6e4e8f4758b59a5d7e90065963/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.596391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fe8aeecfa54e209338f233ed52c0ab, user_id=58b88f6e4e8f4758b59a5d7e90065963, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.599374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad42e-4885-47b5-9c93-184698ccfbc9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.621029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.621029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.622021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 794/1596] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:44 2022] PUT /identity/v3/projects/78fe8aeecfa54e209338f233ed52c0ab/users/58b88f6e4e8f4758b59a5d7e90065963/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:44.623925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.624487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.624966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.643833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 803/1597] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:44.654845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:44.676909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] MFA Rules not processed for user `58b88f6e4e8f4758b59a5d7e90065963`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:44.678385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.719617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.720966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.735038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f975e-6090-47e9-b620-f4875a57fcf9 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.835391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 795/1598] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:44.851821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:44.853361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:44.857437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:44.858405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:44.858811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:44.859080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] PATH_INFO: `/v3/users/1793d1376f654e58851d36f70f8fe602` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:44.860679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1793d1376f654e58851d36f70f8fe602)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:44.863466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:44.897674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:44.953511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1793d1376f654e58851d36f70f8fe602'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.972461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1793d1376f654e58851d36f70f8fe602'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:44.988511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289a423-a26f-41e7-a26f-050b5164c2b9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:44.999840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:45.002102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.002537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.002911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.005028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1793d1376f654e58851d36f70f8fe602'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:45.007495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.008967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1793d1376f654e58851d36f70f8fe602'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:45.026675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1793d1376f654e58851d36f70f8fe602'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:45.045221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 804/1599] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:44 2022] DELETE /identity/v3/users/1793d1376f654e58851d36f70f8fe602 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:45.048155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:45.051764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.133034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:45.134925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43f7e-d7b3-44e8-a663-4223884d55dd service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:45.161049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 796/1600] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:45.165371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b820-5541-4443-8f55-c31668c60564 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.165681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b820-5541-4443-8f55-c31668c60564 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.166373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726b820-5541-4443-8f55-c31668c60564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.202763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192c9f5-9d41-4e27-9541-04fae84ec640 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:45.206662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:45.207300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.207572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.207924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.209715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.211815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a726b820-5541-4443-8f55-c31668c60564 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:45.214583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a726b820-5541-4443-8f55-c31668c60564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.331822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:45.334840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:45.355321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:45.372107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 805/1601] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:45.404375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 797/1602] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:45.437523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:45.439030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.478059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634936-d492-4098-a192-727e69fa4b5b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.478978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634936-d492-4098-a192-727e69fa4b5b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.479327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634936-d492-4098-a192-727e69fa4b5b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.481068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 798/1603] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:42:45.510090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.510265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.511445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.551374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:45.554612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.560461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:45.575658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464021-ca53-4b22-84b3-1b25402627c8 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:45.592036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:45.592700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.595163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.595498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.629961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:45.631964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:45.657768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 806/1604] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:45.714296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 799/1605] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:42:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 11 06:42:45.736318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:45.737918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.766643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96033-e946-4a7a-b714-5b9f66203961 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:45.783164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:45.784513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.785488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.785924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.801208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:45.803653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:45.840084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 807/1606] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:45.907202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:45.908654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:45.923478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83874111-7715-41e9-b282-99cbc93c5539 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:45.929878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:45.930582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:45.930856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:45.931127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] PATH_INFO: `/v3/projects/c0ae445025394c629f8b2ae4e20864a3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:45.944923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ae445025394c629f8b2ae4e20864a3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:45.953241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.066142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ae445025394c629f8b2ae4e20864a3', 'request_id': 'req-dca2db99-1413-4ace-9e64-867eb915bd32'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.081981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ae445025394c629f8b2ae4e20864a3', 'request_id': 'req-dca2db99-1413-4ace-9e64-867eb915bd32'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.090642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ae445025394c629f8b2ae4e20864a3', 'request_id': 'req-dca2db99-1413-4ace-9e64-867eb915bd32'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.101398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.104173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.123054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] The token cache is being invalidate because project c0ae445025394c629f8b2ae4e20864a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:46.123866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6363-ac58-4bf1-9d1c-f50f661f30ef service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:46.125331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.126341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dca2db99-1413-4ace-9e64-867eb915bd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.129625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 800/1607] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:45 2022] DELETE /identity/v3/projects/c0ae445025394c629f8b2ae4e20864a3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:46.137071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37759-7c06-46d7-8962-8fadb6d241ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.137422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37759-7c06-46d7-8962-8fadb6d241ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.137702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37759-7c06-46d7-8962-8fadb6d241ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.171124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9f37759-7c06-46d7-8962-8fadb6d241ca None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:46.173157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9f37759-7c06-46d7-8962-8fadb6d241ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.203987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:46.205508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.206080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.207272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] PATH_INFO: `/v3/projects/039e94e71b8c4b2ca2d7817b45e1225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.209083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] RBAC: Authorizing `identity:delete_project(project_id=039e94e71b8c4b2ca2d7817b45e1225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:46.211743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.281584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039e94e71b8c4b2ca2d7817b45e1225e', 'request_id': 'req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.297387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039e94e71b8c4b2ca2d7817b45e1225e', 'request_id': 'req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.322026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039e94e71b8c4b2ca2d7817b45e1225e', 'request_id': 'req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.326587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 801/1608] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:46.328876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.334128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.335989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.345127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:46.351188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] The token cache is being invalidate because project 039e94e71b8c4b2ca2d7817b45e1225e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:46.351599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.352563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.357098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 808/1609] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:46 2022] DELETE /identity/v3/projects/039e94e71b8c4b2ca2d7817b45e1225e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:46.360170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.364030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.368786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:46.370120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.473344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cafaa9-3f9c-4399-a08a-4bfd1efd384f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:46.479431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:46.480818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.482020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.482416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] PATH_INFO: `/v3/users/09b92ef9f3754bc6a90deb2ff98bb00b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.483736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b92ef9f3754bc6a90deb2ff98bb00b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:46.484856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 802/1610] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:46.490431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.504179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.524149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:46.532508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a553b-bb63-4363-96d9-84861e0538b1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:46.579526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:46.580285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.580589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.580856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.581644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:46.581948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:46.583751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.616829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b92ef9f3754bc6a90deb2ff98bb00b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.634269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b92ef9f3754bc6a90deb2ff98bb00b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.641222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 803/1611] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:46.643635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.655848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b92ef9f3754bc6a90deb2ff98bb00b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.656600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b92ef9f3754bc6a90deb2ff98bb00b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.657077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0650dc4-943e-463c-9e8a-482bc9c1d2d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:46.666326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:46.666944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.667243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.667508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.668330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:46.670303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.678534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b92ef9f3754bc6a90deb2ff98bb00b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:46.688515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 809/1612] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:46 2022] DELETE /identity/v3/users/09b92ef9f3754bc6a90deb2ff98bb00b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:46.712293 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 804/1613] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:46 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:46.716349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.717935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.817803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2396b4-3f9f-4daa-a098-e7c442fd5b77 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:46.934084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:46.936423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:46.936697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:46.937953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:46.938689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:46.940757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:46.951439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:46.958856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:46.992379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239886bf-58a6-4571-abb9-bef5ef411215 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.000045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.000702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.001044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.001327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] PATH_INFO: `/v3/projects/59b532dce1b94bce8fe1850f939569a4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.007587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b532dce1b94bce8fe1850f939569a4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.020840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 810/1614] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:46 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:42:47.023467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.025482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.038375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af9ea7-2912-47d2-b1bf-e323be7e653c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.043701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.044743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.045125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.045472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.046430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.048182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.065711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 811/1615] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:47.067236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.069460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.086241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac8d9-e501-457d-89c3-6f9e6164a42a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.097680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.099683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.099997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.100275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] PATH_INFO: `/v3/projects/a226aaaba0a64598bdfbc1d5b445172a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.103775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a226aaaba0a64598bdfbc1d5b445172a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.108062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.131799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:47.161534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b532dce1b94bce8fe1850f939569a4', 'request_id': 'req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.171475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b532dce1b94bce8fe1850f939569a4', 'request_id': 'req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.179933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b532dce1b94bce8fe1850f939569a4', 'request_id': 'req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.192841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a226aaaba0a64598bdfbc1d5b445172a', 'request_id': 'req-00c27a6f-d169-408a-b2b1-e9f38f4316e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.193762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] The token cache is being invalidate because project 59b532dce1b94bce8fe1850f939569a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:47.194115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.194843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.196434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 805/1616] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:46 2022] DELETE /identity/v3/projects/59b532dce1b94bce8fe1850f939569a4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:47.197287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.198605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.208333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a226aaaba0a64598bdfbc1d5b445172a', 'request_id': 'req-00c27a6f-d169-408a-b2b1-e9f38f4316e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.216395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a226aaaba0a64598bdfbc1d5b445172a', 'request_id': 'req-00c27a6f-d169-408a-b2b1-e9f38f4316e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.229323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] The token cache is being invalidate because project a226aaaba0a64598bdfbc1d5b445172a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:47.229557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.230208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.231779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 812/1617] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:47 2022] DELETE /identity/v3/projects/a226aaaba0a64598bdfbc1d5b445172a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:47.232530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.233914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.262553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:47.279175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741ddd-adb9-4d17-9e95-d3c28576eb6d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.303690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27a6f-d169-408a-b2b1-e9f38f4316e3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.308976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.309578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.310232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.310507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] PATH_INFO: `/v3/users/e29b0684049e40fab2a7beb8a61cc90e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.311812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29b0684049e40fab2a7beb8a61cc90e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.314398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.352186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.352865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.353301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.353552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.354253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.356152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bccb8-bbc1-42df-a84f-6de8577fc5de admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.370632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 806/1618] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:47.372212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.372498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.372767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.383065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29b0684049e40fab2a7beb8a61cc90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.394483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29b0684049e40fab2a7beb8a61cc90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.399155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:47.401115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.411200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29b0684049e40fab2a7beb8a61cc90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.411993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29b0684049e40fab2a7beb8a61cc90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.412767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 807/1619] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:47.413636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.415166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.422859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-134c564d-346d-4b01-9bc7-654546bce1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29b0684049e40fab2a7beb8a61cc90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:47.428394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f63c-2b15-4178-9c75-4c063de2aba9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.432032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 813/1620] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:47 2022] DELETE /identity/v3/users/e29b0684049e40fab2a7beb8a61cc90e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:47.433871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.433871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.434083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.437901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.439839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.440055 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.440313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] PATH_INFO: `/v3/projects/b5125003443145998dad06011fa2a3fb/users/123b21d505ad4cc2891d1475655fb1f3/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.459353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:47.460755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.463403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5125003443145998dad06011fa2a3fb, user_id=123b21d505ad4cc2891d1475655fb1f3, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.468011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0992feb-47d0-4261-989e-2cd9e5d5c55e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.480058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:47.492976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 808/1621] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:47 2022] PUT /identity/v3/projects/b5125003443145998dad06011fa2a3fb/users/123b21d505ad4cc2891d1475655fb1f3/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:47.505242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.505529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.505834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.558047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 814/1622] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:47.573874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.590233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] MFA Rules not processed for user `123b21d505ad4cc2891d1475655fb1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:47.594828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.622571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5f1ec-ec03-423c-83b1-8fcd2fb8ed5a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.779380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.780323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.780651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.780923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.784652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:47.785026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.790914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 809/1623] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:47.791899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.794257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.794743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.812541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00097c-f1ef-416f-bd53-0bfcea42d3bc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.825660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.826798 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 815/1624] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:47.827549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.827877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.828553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.829152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.829958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.834694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.847622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab501e-a0f9-492e-80d5-6f659bd71341 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:47.860880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:47.861582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:47.861843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:47.862112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:47.862760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:47.867022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:47.920211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 810/1625] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:47.924286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.940162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 816/1626] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:47.941917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:47.943522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:47.967600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.023538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b5704-a0eb-4bdc-a562-ee53aa92b8a7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.055165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a5abd-e5dd-4a55-8d76-4a81d93d3efc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.060441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.061243 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.061735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.062110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] PATH_INFO: `/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.063616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d623ee4e3f245438cc5f895a01b6e7c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.065743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.120347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.125158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.125786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.126068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.126335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.127001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.129092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.146648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d623ee4e3f245438cc5f895a01b6e7c', 'request_id': 'req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:48.155421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d623ee4e3f245438cc5f895a01b6e7c', 'request_id': 'req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:48.157452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 811/1627] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:47 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:42:48.158840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.168630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d623ee4e3f245438cc5f895a01b6e7c', 'request_id': 'req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:48.172699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a293d59-9f28-4530-a2d0-324b86b193d9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.186508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] The token cache is being invalidate because project 6d623ee4e3f245438cc5f895a01b6e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:48.186870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:48.187608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:48.189231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 817/1628] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:47 2022] DELETE /identity/v3/projects/6d623ee4e3f245438cc5f895a01b6e7c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:48.193183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.193183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.256425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.257088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.257533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.258038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.258447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.260439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.272387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680a6a-7ac6-4717-b2e1-0f0f136aa154 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.277251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.277814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.278099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.278365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.279151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.280767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135018aa-bcc1-4997-8901-7f01b9cc5799 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.292193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 818/1629] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:48.293470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.293756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.294037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.294585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 812/1630] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:48.296119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.307556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5fe3-a4bd-4d36-897e-e547273e9114 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.314240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:48.315386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.318639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.319427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.320166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.320453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] PATH_INFO: `/v3/projects/33a1029c38c54ad9909ace783c40ddaf/users/e32b189c96e843a8856f65acce7a8bdd/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.323586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 819/1631] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:48.324915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.325875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.338452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64d4de-6c17-46f6-a508-92688a5819a0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.339785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a1029c38c54ad9909ace783c40ddaf, user_id=e32b189c96e843a8856f65acce7a8bdd, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.342979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.345047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.345678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.345980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.346232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.346880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.348539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94658418-63c7-41f5-a221-47ca809702a5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.358908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 820/1632] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:48.360126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.360410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.360685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.366712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 813/1633] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:48 2022] PUT /identity/v3/projects/33a1029c38c54ad9909ace783c40ddaf/users/e32b189c96e843a8856f65acce7a8bdd/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:48.366712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.385426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:48.386642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.409337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.442698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2666-66a2-447e-a14b-227a33212f6f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.447667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.448475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.449129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.449409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.450411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.452060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.457816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 821/1634] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:48.458671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.465705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 814/1635] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:48.466550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.471212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f16d2d-1808-4efe-8367-222653930c64 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.476020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.476175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec4dca-b31a-4cb6-9da8-2504e46663b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.476650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.477058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.477327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.477972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.479628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.481854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.482455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.482728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.483001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.483645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:48.483944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.485570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.492067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 822/1636] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:48.493125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.501656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 815/1637] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:48.504126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac35ddc-5bc6-489a-af89-c85adcafc2b9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.506007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.512284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.512971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.513793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.514071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] PATH_INFO: `/v3/projects/421660181504456995f873b668d9b9be/users/21126dbda9bf4d53b5d41bb757a35338/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.516732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd078e4-b914-45e1-b555-7eaae48088d0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.522719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.525105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.525105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.525271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] PATH_INFO: `/v3/projects/33a1029c38c54ad9909ace783c40ddaf/users/e32b189c96e843a8856f65acce7a8bdd/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.527676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a1029c38c54ad9909ace783c40ddaf, user_id=e32b189c96e843a8856f65acce7a8bdd, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.530799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.535223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421660181504456995f873b668d9b9be, user_id=21126dbda9bf4d53b5d41bb757a35338, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.539362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f3d5-1b57-4a91-bcb5-bea8cb594e81 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.543392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 816/1638] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:48 2022] PUT /identity/v3/projects/33a1029c38c54ad9909ace783c40ddaf/users/e32b189c96e843a8856f65acce7a8bdd/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:48.544287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.580715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 823/1639] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:48 2022] PUT /identity/v3/projects/421660181504456995f873b668d9b9be/users/21126dbda9bf4d53b5d41bb757a35338/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:48.580715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9958ea-8a88-4b67-8dac-0046a68899f7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.580715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9958ea-8a88-4b67-8dac-0046a68899f7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.580715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9958ea-8a88-4b67-8dac-0046a68899f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.581642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.606503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b9958ea-8a88-4b67-8dac-0046a68899f7 None None] MFA Rules not processed for user `e32b189c96e843a8856f65acce7a8bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:48.607817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b9958ea-8a88-4b67-8dac-0046a68899f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.630090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23782b76-f28d-4a03-a917-4a77ea49ba3d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.684049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 824/1640] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:48.685456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.685733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.686001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.714757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.715382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.715646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.715912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.716543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.718520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.724849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] MFA Rules not processed for user `21126dbda9bf4d53b5d41bb757a35338`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:48.726255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.757099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 817/1641] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:48.757099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.757099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:48.814576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.820309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 825/1642] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:48.825957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.838374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df430546-5f8f-4f07-a3b6-1d5513cb6837 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.845392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032114-f4ed-4f0b-913f-dbad66bb3212 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.849646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.850931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.851215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.851487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.906718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869746f7-4219-483b-8c68-777686526507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.907330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869746f7-4219-483b-8c68-777686526507 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.907602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869746f7-4219-483b-8c68-777686526507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.907865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869746f7-4219-483b-8c68-777686526507 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.908515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869746f7-4219-483b-8c68-777686526507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.910454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869746f7-4219-483b-8c68-777686526507 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.933503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.934976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.935332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 826/1643] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:48.936202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869746f7-4219-483b-8c68-777686526507 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.953728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869746f7-4219-483b-8c68-777686526507 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.955051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 818/1644] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:48.955824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:48.960304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.961329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.961606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.961908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.963985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.966638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.967807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7d941-d3db-428a-94bb-77f2b755baf1 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:48.973698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:48.975528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:48.976260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:48.976546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:48.976969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:48.977801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:48.979970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:48.997111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 819/1645] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:48.998053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.010204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c1ad-b491-4795-95e8-d44367f145e8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.016085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.016710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.016989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.017155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 827/1646] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:48 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:49.017380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.018131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.020554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.022412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.037574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 820/1647] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:49.042206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.053913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4af25b-070c-4ad0-8964-996698ebf28b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.137694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1e031-128a-469f-817a-4ae4dc90d932 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.142529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.143254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.143535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.143865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.144522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.147262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.166605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.167596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.168052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.169409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] PATH_INFO: `/v3/projects/916476d95a814539b5c9e70234a0e921/users/151750e985a84f42ae3c093d90136256/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.192169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916476d95a814539b5c9e70234a0e921, user_id=151750e985a84f42ae3c093d90136256, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.194987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.201020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 828/1648] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:49 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:49.202126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.226711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 821/1649] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:49 2022] PUT /identity/v3/projects/916476d95a814539b5c9e70234a0e921/users/151750e985a84f42ae3c093d90136256/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:49.227800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.284390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9144b-171e-4acb-ad54-f660f431d805 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.297577 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:49.320405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384e9c5-4147-4459-ba6a-f5faae3b6d97 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.328760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.329732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.330102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.330252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.331084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.332908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80007b81-b0ca-4219-9ea3-f11d3baf20de admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.353081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 822/1650] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:49.353081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.353861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.354484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.354757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.355025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.355617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.355896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.360201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.394064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] MFA Rules not processed for user `151750e985a84f42ae3c093d90136256`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:49.395393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.422667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:49.435073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.436701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.446736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 829/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:49.447745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.462659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcd0b-24da-4636-b9d9-4b694845de30 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.468202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.468951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.469257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.469521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] PATH_INFO: `/v3/projects/132db47bd6ff4dd6968677b8e03f2d09/users/11887c60e05649a28c0e3898c9166350/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.481191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 823/1652] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:49.484241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.486535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.496759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=132db47bd6ff4dd6968677b8e03f2d09, user_id=11887c60e05649a28c0e3898c9166350, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.499452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.505814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5becc42-6100-428c-81fb-3bb39d3263e2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.511836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.512483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.512757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.513064 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] PATH_INFO: `/v3/users/bfc6baf082684db3a3d09f215e422772` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.514224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc6baf082684db3a3d09f215e422772)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.515723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 830/1653] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:49 2022] PUT /identity/v3/projects/132db47bd6ff4dd6968677b8e03f2d09/users/11887c60e05649a28c0e3898c9166350/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:49.516287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.517863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.588437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc6baf082684db3a3d09f215e422772'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.589332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc6baf082684db3a3d09f215e422772'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.606082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc6baf082684db3a3d09f215e422772'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.615749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb11f89-1f2d-44b0-acd7-ed1355332c6e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.622072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc6baf082684db3a3d09f215e422772'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.622938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.623677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.624435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.624735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.626398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.630599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57994-8473-4a51-bbba-b89a0d060b98 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.630954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc6baf082684db3a3d09f215e422772'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.639991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 824/1654] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:49 2022] DELETE /identity/v3/users/bfc6baf082684db3a3d09f215e422772 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:49.640915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.642684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.670948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 831/1655] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:49.672748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.673259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.673544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.701113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:49.702900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.724462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:49.751629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f786a-b0dc-4465-b983-a29a5323c1fe admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.820751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 832/1656] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:49.821638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.822913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.827349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.827521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.827804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.828076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.828878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.830925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.837452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f460-f7dc-40e4-a653-e404de590f64 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.842348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.842961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.843228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.843489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.847822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 825/1657] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:49.847963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.848044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.848180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.849441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.874839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842c9-ec6f-4fb2-9ff8-93bfde66722a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:49.882221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:49.883441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:49.883626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:49.883890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] PATH_INFO: `/v3/users/123b21d505ad4cc2891d1475655fb1f3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:49.885527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123b21d505ad4cc2891d1475655fb1f3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:49.887680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:49.906564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 833/1658] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:49 2022] POST /identity/v3/users => generated 293 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:49.910022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:49.919913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:49.963216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123b21d505ad4cc2891d1475655fb1f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.964479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123b21d505ad4cc2891d1475655fb1f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:49.965555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:49.982094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123b21d505ad4cc2891d1475655fb1f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.003188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123b21d505ad4cc2891d1475655fb1f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.012001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42cb26-e69f-46f5-90d1-daef0ea4cebc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.014341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123b21d505ad4cc2891d1475655fb1f3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.017975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.019211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.019580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.020111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.023824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 826/1659] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:49 2022] DELETE /identity/v3/users/123b21d505ad4cc2891d1475655fb1f3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:50.023824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.024446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.024694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.041787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.045063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.058073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 834/1660] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:50.058820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.060301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.074441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f399f-4ee9-4222-9248-7cda8d81dce8 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.156606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02a6c-ab03-4db0-8424-927c54672744 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.162857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.163545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.163821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.164337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] PATH_INFO: `/v3/projects/132db47bd6ff4dd6968677b8e03f2d09/users/11887c60e05649a28c0e3898c9166350/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.166889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132db47bd6ff4dd6968677b8e03f2d09, user_id=11887c60e05649a28c0e3898c9166350, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.170077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec0a8-3cbb-4a11-8a9c-1cba61f9b936 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.170282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.171224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.171224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.171431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.172088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.173866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.174023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:50.185351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 827/1661] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:50 2022] PUT /identity/v3/projects/132db47bd6ff4dd6968677b8e03f2d09/users/11887c60e05649a28c0e3898c9166350/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:50.185855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 835/1662] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:50.192373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e68336-37e5-472c-a92e-20e60dee680f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.192373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e68336-37e5-472c-a92e-20e60dee680f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.192373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e68336-37e5-472c-a92e-20e60dee680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.193422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.209264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07623-19c3-43d0-83e9-dc62195e805e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.218128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-06e68336-37e5-472c-a92e-20e60dee680f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:50.219359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06e68336-37e5-472c-a92e-20e60dee680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.330909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 828/1663] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:50.332753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.333260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.333691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.364453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] MFA Rules not processed for user `11887c60e05649a28c0e3898c9166350`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:50.365997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.372340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.373615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.373898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.374180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] PATH_INFO: `/v3/projects/24a1258ade95471cbdc1407458281f7b/users/a41c274c09a54e7b978b5665d9bb3c30/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.392302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a1258ade95471cbdc1407458281f7b, user_id=a41c274c09a54e7b978b5665d9bb3c30, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.397525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.424634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 836/1664] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:50 2022] PUT /identity/v3/projects/24a1258ade95471cbdc1407458281f7b/users/a41c274c09a54e7b978b5665d9bb3c30/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:50.427857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.428740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.535564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 829/1665] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:50.536419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.541807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.620816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e74c-ab4c-4c90-ad07-2165cfb532cb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.627846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.628538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.629256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.629584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.632529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.638424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:50.641256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742521a-a706-41f4-b3e2-5fa02db55f21 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.681414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:50.701896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.702680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.702961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.703226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.732736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.735164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.746526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 837/1666] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:50.747502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.788788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.790522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.813256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 830/1667] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:50.814399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.816149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.834868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50307-e298-43bf-b26d-33cd274cea5a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.840693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.841533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.841811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.842131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] PATH_INFO: `/v3/projects/3f43bfb2566a410a924790b29830a09c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.843447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f43bfb2566a410a924790b29830a09c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.846240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.862989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fccf00-6d31-4d93-9d94-5561bd972959 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.868625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.869521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.869956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.870282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.871000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:50.872555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:50.889104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 838/1668] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:50.889104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.890937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.911752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587daa5-f5bd-4167-a7eb-79d42f2cc99f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:50.927002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f43bfb2566a410a924790b29830a09c', 'request_id': 'req-55defdab-2c35-4236-88ce-e622fd4784a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.940969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f43bfb2566a410a924790b29830a09c', 'request_id': 'req-55defdab-2c35-4236-88ce-e622fd4784a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.954207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f43bfb2566a410a924790b29830a09c', 'request_id': 'req-55defdab-2c35-4236-88ce-e622fd4784a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.970590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] The token cache is being invalidate because project 3f43bfb2566a410a924790b29830a09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:50.970780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.971679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:50.976541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 831/1669] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:50 2022] DELETE /identity/v3/projects/3f43bfb2566a410a924790b29830a09c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:50.976541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:50.976541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:50.979325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:50.980076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:50.980454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:50.980834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:50.987446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.050829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:51.077770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.079502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.095971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55defdab-2c35-4236-88ce-e622fd4784a8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.101575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.102958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.102958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.103250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] PATH_INFO: `/v3/projects/24a1258ade95471cbdc1407458281f7b/users/a41c274c09a54e7b978b5665d9bb3c30/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.106475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a1258ade95471cbdc1407458281f7b, user_id=a41c274c09a54e7b978b5665d9bb3c30, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.107777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 839/1670] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:51.108647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.110153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.113046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.128087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cabb21-a47a-40a3-96ad-27ccc328c7da service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.144212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 832/1671] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:50 2022] PUT /identity/v3/projects/24a1258ade95471cbdc1407458281f7b/users/a41c274c09a54e7b978b5665d9bb3c30/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:51.145314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.149085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.149758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.151572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.151846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] PATH_INFO: `/v3/users/cea03f0f83964506b3380859e9e239b9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.153153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea03f0f83964506b3380859e9e239b9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.154111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.155089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.162435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:51.297421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea03f0f83964506b3380859e9e239b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.308210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c690e47-1444-440a-9781-e6c3008aed47 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.318608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea03f0f83964506b3380859e9e239b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.321888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.322603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.324420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.324694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] PATH_INFO: `/v3/projects/b5125003443145998dad06011fa2a3fb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.331138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5125003443145998dad06011fa2a3fb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.334377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.354529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea03f0f83964506b3380859e9e239b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.355424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea03f0f83964506b3380859e9e239b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.365465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66967d2e-dda2-4546-9aa7-71c8d76e7d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea03f0f83964506b3380859e9e239b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.374430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 840/1672] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:51 2022] DELETE /identity/v3/users/cea03f0f83964506b3380859e9e239b9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:51.375680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.375972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.376237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.391881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5125003443145998dad06011fa2a3fb', 'request_id': 'req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.408373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] MFA Rules not processed for user `a41c274c09a54e7b978b5665d9bb3c30`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:51.409838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.417639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5125003443145998dad06011fa2a3fb', 'request_id': 'req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.425353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5125003443145998dad06011fa2a3fb', 'request_id': 'req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.438764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] The token cache is being invalidate because project b5125003443145998dad06011fa2a3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:51.439456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.440322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.442034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 833/1673] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:51 2022] DELETE /identity/v3/projects/b5125003443145998dad06011fa2a3fb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:51.446162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.447821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.492955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 841/1674] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:51.493843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.495441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.542397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f2e27-6ca4-41d7-81a0-9d200d5ab15a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.547875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.548871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.549352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.549821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] PATH_INFO: `/v3/users/21126dbda9bf4d53b5d41bb757a35338` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.551210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=21126dbda9bf4d53b5d41bb757a35338)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.553698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.559006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:51.590013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32acf1-2fad-475d-9932-d7f9f89aa110 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.595648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.596473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.597055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.597289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] PATH_INFO: `/v3/users/e32b189c96e843a8856f65acce7a8bdd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.598509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32b189c96e843a8856f65acce7a8bdd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:51.600663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:51.649449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:51.669960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21126dbda9bf4d53b5d41bb757a35338'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.671159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32b189c96e843a8856f65acce7a8bdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.675031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21126dbda9bf4d53b5d41bb757a35338'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.689404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32b189c96e843a8856f65acce7a8bdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.697576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21126dbda9bf4d53b5d41bb757a35338'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.709684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32b189c96e843a8856f65acce7a8bdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.710632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32b189c96e843a8856f65acce7a8bdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.724641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32b189c96e843a8856f65acce7a8bdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.736323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 842/1675] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:51 2022] DELETE /identity/v3/users/e32b189c96e843a8856f65acce7a8bdd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:51.736323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.744686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21126dbda9bf4d53b5d41bb757a35338'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.747949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.753429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-865b4760-5c88-4ce7-92e4-005893ee2caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21126dbda9bf4d53b5d41bb757a35338'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:51.761675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 834/1676] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:51 2022] DELETE /identity/v3/users/21126dbda9bf4d53b5d41bb757a35338 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:51.766080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.766627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.767267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.793738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:51.796207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.838087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4c0e4-c7ac-4e74-864b-89f294c48243 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:51.889139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 835/1677] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:51.932096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:51.935214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:51.977778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:51.978469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:51.978765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:51.984565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:51.993108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.101561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:52.113432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0789-e15d-4dba-9590-4e17a1f1f5ac None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:52.123060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:52.124416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.124761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.125174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.165653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.170602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.171020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.172739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.184331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 843/1678] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:52.185254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.186773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.205397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9c08-f442-41d0-9d41-e08c71d58f1c service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:52.207270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 836/1679] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:52.208242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.209966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.229068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41904-c077-4001-b236-28072a2ca640 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:52.229464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:52.230136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.230410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.230676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] PATH_INFO: `/v3/projects/6a910413f77549d292cffcc1cddbcb8f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.232752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a910413f77549d292cffcc1cddbcb8f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.234900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.235827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:52.236762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.237163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.237527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] PATH_INFO: `/v3/projects/33a1029c38c54ad9909ace783c40ddaf` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.238897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a1029c38c54ad9909ace783c40ddaf)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.241379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.316294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a1029c38c54ad9909ace783c40ddaf', 'request_id': 'req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.319310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:52.327463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a910413f77549d292cffcc1cddbcb8f', 'request_id': 'req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.337954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a1029c38c54ad9909ace783c40ddaf', 'request_id': 'req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.342159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a910413f77549d292cffcc1cddbcb8f', 'request_id': 'req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.346730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a1029c38c54ad9909ace783c40ddaf', 'request_id': 'req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.353866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a910413f77549d292cffcc1cddbcb8f', 'request_id': 'req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.365581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] The token cache is being invalidate because project 33a1029c38c54ad9909ace783c40ddaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:52.365876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.366562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1bd2647c-b7e3-4df1-9143-0e6c19f91a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.368678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 837/1680] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:52 2022] DELETE /identity/v3/projects/33a1029c38c54ad9909ace783c40ddaf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:52.374229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151244c6-4242-45e9-ad83-3a71a846681e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.374919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151244c6-4242-45e9-ad83-3a71a846681e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.374919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151244c6-4242-45e9-ad83-3a71a846681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.376640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] The token cache is being invalidate because project 6a910413f77549d292cffcc1cddbcb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:52.377191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.378111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3fea41f3-df5d-4e06-a8e4-e9a1a5f9b819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:52.382039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 844/1681] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:52 2022] DELETE /identity/v3/projects/6a910413f77549d292cffcc1cddbcb8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:52.388030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75b70-8c14-48b3-8e95-93b5d72aa31a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.388614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75b70-8c14-48b3-8e95-93b5d72aa31a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.389115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b75b70-8c14-48b3-8e95-93b5d72aa31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.399340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-151244c6-4242-45e9-ad83-3a71a846681e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:52.400787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-151244c6-4242-45e9-ad83-3a71a846681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.447617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-88b75b70-8c14-48b3-8e95-93b5d72aa31a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:52.451626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-88b75b70-8c14-48b3-8e95-93b5d72aa31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.602000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 838/1682] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:52.616489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.616489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.616489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.658335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:52.659584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.675464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 839/1683] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:52.679452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.682046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 845/1684] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:52.687881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.688202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.688436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.699091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8219af6-c7af-4b9f-be28-37d9599ceb16 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:52.712483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:52.713254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.713527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.713784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.714504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:52.714798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.722398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.746588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 840/1685] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:42:52.750066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.770748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902de583-d5ec-4720-baf4-788ddbddbe33 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:52.770970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:52.772160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:52.781819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:52.782326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:52.783273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:52.783273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:52.783521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:52.786572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:52.803795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 846/1686] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:52.809261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.846296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 841/1687] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:52.851858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:52.852981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406b6d-ba16-49a2-ace9-a8bb9d62cec8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.011336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceff8f-9602-4d32-b4f5-10ff1a4d9883 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.022665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.024801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.026713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.028042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.029918 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.031324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.036236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.053142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.053461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.053770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.054318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.054715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:53.055020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.058520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.078436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 842/1688] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:52 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:53.082255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.089993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 847/1689] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:42:53.091079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.096068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7756d21-8bb8-4217-97a2-e4ae0d22ff96 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.104007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734742f-112e-4c03-b8ac-d9ac16f547b9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.113914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.114612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.114919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.115336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.115898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.118280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.120561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.120561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.120561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.121307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.123434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.125294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.141259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 843/1690] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:42:53.142241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.144206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.160887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11526d58-6c58-46f1-a5ad-ea76884b723b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.166772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.166772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.166772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.166772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] PATH_INFO: `/v3/projects/421660181504456995f873b668d9b9be` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.168173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=421660181504456995f873b668d9b9be)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.168290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 848/1691] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:53.168911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.170028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.182047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.231492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421660181504456995f873b668d9b9be', 'request_id': 'req-67370f5f-0115-43af-a582-6db86f6716ef'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.239422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421660181504456995f873b668d9b9be', 'request_id': 'req-67370f5f-0115-43af-a582-6db86f6716ef'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.243426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e336e-c1d6-470e-9f79-3d7ba44c15be admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.245550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421660181504456995f873b668d9b9be', 'request_id': 'req-67370f5f-0115-43af-a582-6db86f6716ef'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.257413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] The token cache is being invalidate because project 421660181504456995f873b668d9b9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:53.257691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.258405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.259912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 844/1692] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:53 2022] DELETE /identity/v3/projects/421660181504456995f873b668d9b9be => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:53.262981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.262981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.306149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.306771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.307044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.307308 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.307959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.309668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.319773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 849/1693] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:53.320629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.322252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.329908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370f5f-0115-43af-a582-6db86f6716ef admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.335134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74568acf-f45e-4f46-bf14-b6188d626db1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.335611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.335906 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.336176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.336440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.337165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.339346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.340043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.340663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.340937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.341236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] PATH_INFO: `/v3/users/11887c60e05649a28c0e3898c9166350` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.342353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11887c60e05649a28c0e3898c9166350)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.344236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.367857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 845/1694] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:53.367857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.369354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.382920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081e05e-0695-4719-ae0b-1f764612f954 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.387691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.388347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.388628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.388894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] PATH_INFO: `/v3/projects/951fbd94d2174aa5b60f853c73125993/users/2e9e3610fe0c47089d718dc378b530b9/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.394530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11887c60e05649a28c0e3898c9166350'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.403141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11887c60e05649a28c0e3898c9166350'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.405122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] RBAC: Authorizing `identity:create_grant(project_id=951fbd94d2174aa5b60f853c73125993, user_id=2e9e3610fe0c47089d718dc378b530b9, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.408043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.409742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.418946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11887c60e05649a28c0e3898c9166350'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.419498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11887c60e05649a28c0e3898c9166350'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.422062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 846/1695] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:53 2022] PUT /identity/v3/projects/951fbd94d2174aa5b60f853c73125993/users/2e9e3610fe0c47089d718dc378b530b9/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:53.422762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.424336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.435278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9bece5da-f3c3-41ee-8175-22dece5b2481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11887c60e05649a28c0e3898c9166350'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:53.441591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 850/1696] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:53 2022] DELETE /identity/v3/users/11887c60e05649a28c0e3898c9166350 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:53.442882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.443164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.443436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.476102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] MFA Rules not processed for user `2e9e3610fe0c47089d718dc378b530b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:53.477386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.500702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748829c-8026-4782-bf15-9902822e549d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.515423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.562314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 851/1697] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:53.566739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.569709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.588120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.588740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.589052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.589326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.589977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.591632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.605053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 847/1698] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:53.607678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.618970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac14f2-36b7-4133-b423-ee99bf07cfb6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.637814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.638508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.638847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.639086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.640019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.642468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.645176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbdee3-4002-4521-b9d7-47b118e1424e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.650485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.651149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.651474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.651748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.652449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.654221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 848/1699] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:53.657661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.658303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.673441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab5f7d-f1f3-47ea-bbd5-b9e273cdd329 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.679535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.680426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.680851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.681289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] PATH_INFO: `/v3/projects/89f4ca96125f42768b3afd76c6940802/users/8b5a9a7e0a7240f5887647f7ebac8fc7/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.694666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 852/1700] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:53.696085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.702008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f4ca96125f42768b3afd76c6940802, user_id=8b5a9a7e0a7240f5887647f7ebac8fc7, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.706217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f8f92-675f-4f70-a6f5-9e58718aa093 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.738094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 849/1701] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:53 2022] PUT /identity/v3/projects/89f4ca96125f42768b3afd76c6940802/users/8b5a9a7e0a7240f5887647f7ebac8fc7/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:53.748836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.752599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.752722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.772872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:53.787784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c6425-7b24-4700-b85b-4b06b1dc3e84 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.817451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] MFA Rules not processed for user `8b5a9a7e0a7240f5887647f7ebac8fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:53.818710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.901690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.903141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.903414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.903972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.904853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.907442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.941282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 853/1702] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:53.941481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 850/1703] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:53.942125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.944682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:53.945529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:53.959683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4780-ff2c-4044-9c80-f74c00a4a757 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.960396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f125f1-4502-4788-aa61-be26bd9c27e7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:53.965918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.966017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:53.966457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.966565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:53.966742 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.966838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:53.967336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] PATH_INFO: `/v3/projects/132db47bd6ff4dd6968677b8e03f2d09` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.967461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:53.967758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.968195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=132db47bd6ff4dd6968677b8e03f2d09)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:53.969908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.970123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:53.982927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 851/1704] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:42:53.983835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.004112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7e438-f1d0-4bc3-987f-6fdb2696dec4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.012042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.012755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.013099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.013607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.014281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.016933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.059421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132db47bd6ff4dd6968677b8e03f2d09', 'request_id': 'req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:54.060198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 852/1705] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:53 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.061406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.071454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132db47bd6ff4dd6968677b8e03f2d09', 'request_id': 'req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:54.082652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132db47bd6ff4dd6968677b8e03f2d09', 'request_id': 'req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:54.095093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] The token cache is being invalidate because project 132db47bd6ff4dd6968677b8e03f2d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:54.095451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:54.096263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:54.098149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 854/1706] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:53 2022] DELETE /identity/v3/projects/132db47bd6ff4dd6968677b8e03f2d09 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:54.098866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.100101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.107430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:54.145591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea8b6e-bda0-4eed-a42b-2a942bef3c37 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.150597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.151215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.151485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.151748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.152393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.154788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb650c-cfee-46d6-bfda-a01f5f4f776d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.170294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 853/1707] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:54.171821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.172638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.172907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.195003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:54.196219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.202151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b929b6-9cca-4bf9-b0c1-b02bf6f0a6cc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.207512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.208249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.208616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.209130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.209242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 854/1708] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:54.209931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.210043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.211651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.212116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ca15-b8fc-4afa-8a2e-32f61d0c36c6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.238429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c52419-97c7-4c37-90a6-79c8822165c1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.241723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 855/1709] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.245585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.245585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.245585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.252893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.253599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.253860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.254129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] PATH_INFO: `/v3/projects/a3c9427aea8740c7b74ca6370c4ed057/users/fdb2865413e841c29661fa5918d37811/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.261731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:54.280389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:54.281854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.286551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c9427aea8740c7b74ca6370c4ed057, user_id=fdb2865413e841c29661fa5918d37811, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.289753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.293936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 856/1710] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:54.295568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.306714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd3e1-5e82-417b-9aec-adfbd852ddd2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.317313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 855/1711] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:54 2022] PUT /identity/v3/projects/a3c9427aea8740c7b74ca6370c4ed057/users/fdb2865413e841c29661fa5918d37811/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:54.318237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.399950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586963-4ab3-47ff-8988-db93772d6d98 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.404903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.405624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.405920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.406157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.407221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:54.407221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.408802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b7fa4-5de1-4fac-bd17-501bc0dd96f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.424334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 856/1712] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:54.426214 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.426659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.426931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.427792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.428424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.428693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.428956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.429630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.431213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.442219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 857/1713] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:54.443059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.454099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afbbe9-3935-4b83-a262-c0cf65c81ba1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.456342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] MFA Rules not processed for user `fdb2865413e841c29661fa5918d37811`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:54.457644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.458826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.459432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.459703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.459970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.460605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.462519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.493513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 858/1714] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.494580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.528455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 857/1715] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:54.529331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.541862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6e5de-0544-4e06-aa93-7eb086af2be4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.555552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:54.576752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef5a2-c7f9-47d2-8062-ca00c5d3e01b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.583250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.583935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.584213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.584545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] PATH_INFO: `/v3/projects/e5b421044c8741e194f5310e5e2cefba/users/5989f9480ef4411bb41baf3e6bc464a2/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.601557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b421044c8741e194f5310e5e2cefba, user_id=5989f9480ef4411bb41baf3e6bc464a2, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.604390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.605259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.605885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.606143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.606436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.607057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.608980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.619449 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 859/1716] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:54 2022] PUT /identity/v3/projects/e5b421044c8741e194f5310e5e2cefba/users/5989f9480ef4411bb41baf3e6bc464a2/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:54.620378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.632537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 858/1717] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.633386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.645603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268069e2-ff69-4580-9164-2cb9df03920c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.675286 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:54.687312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d38c-4cc9-4a90-90a3-0cdc8bdd68fc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.692432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.693158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.693359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.693623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.694261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.696156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.704638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.705286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.705561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.705928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.706653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.708892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.719823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 859/1718] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:54.720661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.724889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 860/1719] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.728900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.730545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3967f7-62d5-4c54-8ac6-ec2690656c09 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.791813 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.792429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.792534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0dbbe-3314-4782-b074-1f8035276157 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.792705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.792970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.793642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.795605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.797089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.797756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.798034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.798296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] PATH_INFO: `/v3/projects/e5b421044c8741e194f5310e5e2cefba/users/5989f9480ef4411bb41baf3e6bc464a2/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.800195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b421044c8741e194f5310e5e2cefba, user_id=5989f9480ef4411bb41baf3e6bc464a2, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.802958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.805325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 860/1720] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:54.806176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.815788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3e64c-eccd-4503-87f0-163ee710eaa5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.819381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 861/1721] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:54 2022] PUT /identity/v3/projects/e5b421044c8741e194f5310e5e2cefba/users/5989f9480ef4411bb41baf3e6bc464a2/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:54.820462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.863986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:54.886640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.887259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.887530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.887799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.888433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.890420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.891972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfd862-143d-4d60-80d1-896d61972611 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.896712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.897365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.897641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.897908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.898552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.900134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df98d3-70c8-4110-a7cf-1767848706ac admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.910706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 862/1722] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:54.912037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5254c6-7122-4751-b0cd-de047a8b164d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.912327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5254c6-7122-4751-b0cd-de047a8b164d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.912583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5254c6-7122-4751-b0cd-de047a8b164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.916101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 861/1723] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:54.916101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:54.925446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776af2f5-2d3d-49cd-8c8a-38142c76cfde admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:54.930450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:54.931091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:54.931365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:54.931633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] PATH_INFO: `/v3/projects/b41189e4d8dc4426bfeffe43de13a9ba/users/70ad7cf537824a0ab6324db6b75ce574/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:54.941318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ea5254c6-7122-4751-b0cd-de047a8b164d None None] MFA Rules not processed for user `5989f9480ef4411bb41baf3e6bc464a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:54.942648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ea5254c6-7122-4751-b0cd-de047a8b164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:54.946730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41189e4d8dc4426bfeffe43de13a9ba, user_id=70ad7cf537824a0ab6324db6b75ce574, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:54.949347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:54.962847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 862/1724] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:54 2022] PUT /identity/v3/projects/b41189e4d8dc4426bfeffe43de13a9ba/users/70ad7cf537824a0ab6324db6b75ce574/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:54.963719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.007285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:55.019738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 863/1725] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:55.021079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.021527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.021731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.027970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96011e5-a62b-4ee3-bf72-bcf3ea05b687 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.033427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.034071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.034444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.034719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.035467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.037204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.047247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 863/1726] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:55.048103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.049835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.052811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] MFA Rules not processed for user `70ad7cf537824a0ab6324db6b75ce574`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:55.054134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.106881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d4f12-da62-4914-90d3-c2148e5d04ed admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.110710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.111424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.111819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.112147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.127663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 864/1727] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:55.128496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.144637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc34a1-38fa-44b7-a53a-dc7a448e098f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.149955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.150632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.150906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.151177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] PATH_INFO: `/v3/projects/d5ad68b506714e119f57f8c3d12ae411/users/5737e49abd3140aa90d85469b5baa729/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.167474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ad68b506714e119f57f8c3d12ae411, user_id=5737e49abd3140aa90d85469b5baa729, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.170241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.171738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:55.184740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.186819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.187818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 865/1728] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:55 2022] PUT /identity/v3/projects/d5ad68b506714e119f57f8c3d12ae411/users/5737e49abd3140aa90d85469b5baa729/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:55.188770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.202884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 864/1729] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:55.204368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.219247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211f2a-0f33-4c0a-88b5-4ef15a8132ff service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.260389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953a22a-33cc-4079-b823-fc988be0367d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.265660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.266550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.266936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.267580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.268301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.271888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.315169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 866/1730] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:55 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:55.316175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.318841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.351528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.357942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.358605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.359166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.360248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.364382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.377724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 865/1731] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:55.378545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.392033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b79541-baf2-4df0-a915-929cca90859c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.394848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:55.409036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5ad5-7144-4e73-9867-28693a34ad63 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.414128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.414906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.415273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.415608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] PATH_INFO: `/v3/users/151750e985a84f42ae3c093d90136256` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.416976 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] RBAC: Authorizing `identity:delete_user(user_id=151750e985a84f42ae3c093d90136256)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.419162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.475891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.478980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.479876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.480325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.481183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.483619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.518655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 866/1732] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:42:55 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:55.519711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.522189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151750e985a84f42ae3c093d90136256'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:55.532222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba402d-6a04-4b69-911d-5e22bc5af32f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.538070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.538949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.539417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.540024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] PATH_INFO: `/v3/projects/d5ad68b506714e119f57f8c3d12ae411/users/5737e49abd3140aa90d85469b5baa729/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.540599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151750e985a84f42ae3c093d90136256'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:55.545910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ad68b506714e119f57f8c3d12ae411, user_id=5737e49abd3140aa90d85469b5baa729, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.550274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.569105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 867/1733] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:55 2022] PUT /identity/v3/projects/d5ad68b506714e119f57f8c3d12ae411/users/5737e49abd3140aa90d85469b5baa729/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:55.570078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.571146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151750e985a84f42ae3c093d90136256'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:55.574539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151750e985a84f42ae3c093d90136256'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:55.584598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-49bac9c1-5aa3-44b5-bbba-dda8af1b833b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151750e985a84f42ae3c093d90136256'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:55.600751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 867/1734] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:55 2022] DELETE /identity/v3/users/151750e985a84f42ae3c093d90136256 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:55.602069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.602351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.602612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.658410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd37d4f-0798-4924-b5ca-09a552cbadd7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.659150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] MFA Rules not processed for user `5737e49abd3140aa90d85469b5baa729`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:55.660407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.674359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:55.729884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.730823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.730823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.731048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.731691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.733535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbeb78-5e25-4061-a358-06ba31c1560c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.745901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 868/1735] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:55.750973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.751260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.751659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.762559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 868/1736] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:55.762559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.762559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.776441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:55.777883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.781319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce77c-fc50-46df-a29e-ed5666ac2660 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.787500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 869/1737] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:55.788000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.788391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.789711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.789957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.790693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.791799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] PATH_INFO: `/v3/projects/abbad021e87b4db7af820e5237a93259/users/6cd9c163117e49b7a4f6c0b6137eec98/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.828116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbad021e87b4db7af820e5237a93259, user_id=6cd9c163117e49b7a4f6c0b6137eec98, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:55.832246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:55.850383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 869/1738] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:55 2022] PUT /identity/v3/projects/abbad021e87b4db7af820e5237a93259/users/6cd9c163117e49b7a4f6c0b6137eec98/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:55.851535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:55.853484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:55.865639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ab1f8-ec20-4ff4-9249-4decfb4ecfdd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.883156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:55.920237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc653f-4855-4719-89b7-5949b595bb50 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:55.924000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.924630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.925127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.925344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.942756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:55.943514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:55.943807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:55.944031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:55.948232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.005170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.007265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.020874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 870/1739] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:56.021881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.032678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2563-e1e2-4856-8ca1-1fb4b75d8ad3 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.038905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.039527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.039802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.040069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.040713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.043147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.051399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.053213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b35f9-152d-4618-9ed2-9b989b5e9b69 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.056564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 871/1740] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:42:56.068869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.082164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 870/1741] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:56.084855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963169b-875c-4511-8a0f-bf27787808d4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.099334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.100438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.100820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.101266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] PATH_INFO: `/v3/projects/abbad021e87b4db7af820e5237a93259/users/6cd9c163117e49b7a4f6c0b6137eec98/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.103661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbad021e87b4db7af820e5237a93259, user_id=6cd9c163117e49b7a4f6c0b6137eec98, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.106971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.136714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 872/1742] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:42:56 2022] PUT /identity/v3/projects/abbad021e87b4db7af820e5237a93259/users/6cd9c163117e49b7a4f6c0b6137eec98/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:56.147172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.147459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.147732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.180051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:56.200884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] MFA Rules not processed for user `6cd9c163117e49b7a4f6c0b6137eec98`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:56.202386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.216727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.220103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.304513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 871/1743] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:56.320305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.322455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.337970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1f35b-08c0-4f34-9194-8f1ec3dd92fb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.352152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.353248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.353678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.355023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] PATH_INFO: `/v3/users/8b5a9a7e0a7240f5887647f7ebac8fc7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.357569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5a9a7e0a7240f5887647f7ebac8fc7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.362715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.411158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468edc5-2076-4bd6-aa3f-6c9a789d3b93 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.415610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.416780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.417083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.417428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.429127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.430639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0757cc-9ce0-4d61-81ad-2445bed2a448 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.437865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5a9a7e0a7240f5887647f7ebac8fc7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.442661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:56.452479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5a9a7e0a7240f5887647f7ebac8fc7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.463156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 872/1744] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:56.475298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5a9a7e0a7240f5887647f7ebac8fc7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.476611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5a9a7e0a7240f5887647f7ebac8fc7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.487556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5a9a7e0a7240f5887647f7ebac8fc7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.501157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 873/1745] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:56 2022] DELETE /identity/v3/users/8b5a9a7e0a7240f5887647f7ebac8fc7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:56.502661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.502943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.503217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.536356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:56.538066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.588035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.590808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.663336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 873/1746] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:42:56.675378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.693169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.754969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828551-7e2b-4fa3-b7e3-77ef68479c85 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.767848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.768566 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.768845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.769178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] PATH_INFO: `/v3/projects/916476d95a814539b5c9e70234a0e921` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.773221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916476d95a814539b5c9e70234a0e921)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.775178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.815550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:56.856210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e9abd-aab6-4ead-a982-8f592b6f583e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.862237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:56.864932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:56.865281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:56.865676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:56.887776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916476d95a814539b5c9e70234a0e921', 'request_id': 'req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.890878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:56.892731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:56.911508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916476d95a814539b5c9e70234a0e921', 'request_id': 'req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.917526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 874/1747] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:56.919556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.924584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:56.927316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916476d95a814539b5c9e70234a0e921', 'request_id': 'req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.953746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] The token cache is being invalidate because project 916476d95a814539b5c9e70234a0e921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:56.954075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.955714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:56.956747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1bdec-d63e-447d-8903-5a210cb7128e service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:56.958656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 874/1748] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:56 2022] DELETE /identity/v3/projects/916476d95a814539b5c9e70234a0e921 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:42:56.962279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:56.965423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.096061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.097981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.099107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.099580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] PATH_INFO: `/v3/users/2cd6c067ae804f7e9fa116b3c589a429` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.102288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd6c067ae804f7e9fa116b3c589a429)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.108411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.124280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b3d4b-e31c-49d0-be47-2930bde5f9d1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.136558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.137833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.140495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.140879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] PATH_INFO: `/v3/users/a41c274c09a54e7b978b5665d9bb3c30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.144121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41c274c09a54e7b978b5665d9bb3c30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.149725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.152343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:57.218880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd6c067ae804f7e9fa116b3c589a429'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.224859 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd6c067ae804f7e9fa116b3c589a429'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.252117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd6c067ae804f7e9fa116b3c589a429'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.273182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41c274c09a54e7b978b5665d9bb3c30'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.292438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41c274c09a54e7b978b5665d9bb3c30'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.298937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd6c067ae804f7e9fa116b3c589a429'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.314485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41c274c09a54e7b978b5665d9bb3c30'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.317591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41c274c09a54e7b978b5665d9bb3c30'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.323098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd6c067ae804f7e9fa116b3c589a429'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.327695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7a7077d-ef95-46a0-9387-77d6d42928a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41c274c09a54e7b978b5665d9bb3c30'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.332037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 875/1749] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:56 2022] DELETE /identity/v3/users/2cd6c067ae804f7e9fa116b3c589a429 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:57.333169 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.338565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.339385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 875/1750] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:56 2022] DELETE /identity/v3/users/a41c274c09a54e7b978b5665d9bb3c30 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:57.341350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.341640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.341910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.363726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:57.365039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.425320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ec22a-8ba4-48fc-925d-fd04d8ecb139 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.432828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:57.443099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 876/1751] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:57.458594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.460268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.537631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd9c163117e49b7a4f6c0b6137eec98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abbad021e87b4db7af820e5237a93259', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.538545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.538727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.538914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.540861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:57.543451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.545146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.558971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 876/1752] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:57.562474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.574429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b01c8-ccc5-4323-8e21-e9a1dbc96eb9 tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.579141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02becc9-1824-4f31-b61d-e5cb6af85bb2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.587494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd9c163117e49b7a4f6c0b6137eec98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abbad021e87b4db7af820e5237a93259', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.588129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.588961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.590090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.590367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.590637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.591159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.591442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.592090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.595421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.604289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.606065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.620463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 877/1753] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:57.638139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 877/1754] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:42:57 2022] POST /identity/v3/projects => generated 355 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:42:57.641757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.664617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1645-b488-41dd-9633-a2f762353dbf service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.695326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:57.730149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.734848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.749295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd9c163117e49b7a4f6c0b6137eec98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abbad021e87b4db7af820e5237a93259', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.750435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.750548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.751025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.751850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:57.752349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.761349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.794047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 878/1755] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:57.842721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:57.846095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.888403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ced833-9250-4a17-8654-932f78a1730b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.895009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.896053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.896463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.896922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] PATH_INFO: `/v3/projects/89f4ca96125f42768b3afd76c6940802` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.898262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f4ca96125f42768b3afd76c6940802)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:57.900181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:57.931892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b42ba2-c037-4d02-ae46-14416d85499b tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:57.937954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:57.938872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:57.939172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:57.939451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:57.946364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:57.966878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f4ca96125f42768b3afd76c6940802', 'request_id': 'req-4667d1d0-7943-4470-9936-64a68e0c9dcf'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.976872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f4ca96125f42768b3afd76c6940802', 'request_id': 'req-4667d1d0-7943-4470-9936-64a68e0c9dcf'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:57.988074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f4ca96125f42768b3afd76c6940802', 'request_id': 'req-4667d1d0-7943-4470-9936-64a68e0c9dcf'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.005524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] The token cache is being invalidate because project 89f4ca96125f42768b3afd76c6940802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:58.006218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.007235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.010183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 878/1756] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:57 2022] DELETE /identity/v3/projects/89f4ca96125f42768b3afd76c6940802 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:58.011925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.013640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:58.029879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:58.031706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:58.038593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:58.048225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 879/1757] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:42:58.049310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.068545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee372c-f801-4b0d-926d-0f2750047ef9 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:58.148584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:58.149552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:58.150608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:58.151097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] PATH_INFO: `/v3/users/5989f9480ef4411bb41baf3e6bc464a2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:58.152422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5989f9480ef4411bb41baf3e6bc464a2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:58.155003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:58.168580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667d1d0-7943-4470-9936-64a68e0c9dcf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:58.182816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd9c163117e49b7a4f6c0b6137eec98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abbad021e87b4db7af820e5237a93259', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:58.183757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:58.184139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:58.184516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] PATH_INFO: `/v3/projects/aad54511093e45b1ab8002f3d2a47803` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:58.185805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:58.187039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aad54511093e45b1ab8002f3d2a47803)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:58.190353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:58.238993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5989f9480ef4411bb41baf3e6bc464a2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.254853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5989f9480ef4411bb41baf3e6bc464a2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.310610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5989f9480ef4411bb41baf3e6bc464a2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.316780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5989f9480ef4411bb41baf3e6bc464a2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.316964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad54511093e45b1ab8002f3d2a47803', 'request_id': 'req-3f21187b-c294-4c25-aa26-a6fc0054995a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.342931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad54511093e45b1ab8002f3d2a47803', 'request_id': 'req-3f21187b-c294-4c25-aa26-a6fc0054995a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.345117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5989f9480ef4411bb41baf3e6bc464a2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.362535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad54511093e45b1ab8002f3d2a47803', 'request_id': 'req-3f21187b-c294-4c25-aa26-a6fc0054995a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.367565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 880/1758] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/users/5989f9480ef4411bb41baf3e6bc464a2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:58.372975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.377106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:58.406462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] The token cache is being invalidate because project aad54511093e45b1ab8002f3d2a47803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:58.408306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.409188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.414364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 879/1759] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/projects/aad54511093e45b1ab8002f3d2a47803 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:58.468550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.470026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:58.604703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21187b-c294-4c25-aa26-a6fc0054995a tempest-VolumeQuotaClassesTest-1490190642 tempest-VolumeQuotaClassesTest-1490190642-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:58.610604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb6155-0d6e-4cbd-8d51-6774a687475f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:58.617438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:58.618201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:58.618474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:58.618781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] PATH_INFO: `/v3/projects/28e8b09d9f184169acc347bfb950f22d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:58.621679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e8b09d9f184169acc347bfb950f22d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:58.622152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:58.622826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:58.623105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:58.623375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] PATH_INFO: `/v3/projects/24a1258ade95471cbdc1407458281f7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:58.623762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:58.624867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a1258ade95471cbdc1407458281f7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:58.631526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:58.760834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:58.774156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e8b09d9f184169acc347bfb950f22d', 'request_id': 'req-b885e044-441d-4155-b8a2-a9f023831b88'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.795643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e8b09d9f184169acc347bfb950f22d', 'request_id': 'req-b885e044-441d-4155-b8a2-a9f023831b88'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.797892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a1258ade95471cbdc1407458281f7b', 'request_id': 'req-db299064-e4ae-462c-8b91-b60cab9c27e6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.811748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e8b09d9f184169acc347bfb950f22d', 'request_id': 'req-b885e044-441d-4155-b8a2-a9f023831b88'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.819144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a1258ade95471cbdc1407458281f7b', 'request_id': 'req-db299064-e4ae-462c-8b91-b60cab9c27e6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.827378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a1258ade95471cbdc1407458281f7b', 'request_id': 'req-db299064-e4ae-462c-8b91-b60cab9c27e6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.860914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] The token cache is being invalidate because project 24a1258ade95471cbdc1407458281f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:58.868877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] The token cache is being invalidate because project 28e8b09d9f184169acc347bfb950f22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:58.868993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.869176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.869267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.869351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:58.876265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 881/1761] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/projects/24a1258ade95471cbdc1407458281f7b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:58.876265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.876536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 880/1761] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/projects/28e8b09d9f184169acc347bfb950f22d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:58.876806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:58.880004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:58.881347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:58.932134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:59.034428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299064-e4ae-462c-8b91-b60cab9c27e6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.040627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:59.041672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.042226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.042705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] PATH_INFO: `/v3/users/70ad7cf537824a0ab6324db6b75ce574` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.044161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ad7cf537824a0ab6324db6b75ce574)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:59.046678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:59.063434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e044-441d-4155-b8a2-a9f023831b88 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.074877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:59.078554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.078554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.078554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] PATH_INFO: `/v3/users/58b88f6e4e8f4758b59a5d7e90065963` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.080142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b88f6e4e8f4758b59a5d7e90065963)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:59.083320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:59.153205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ad7cf537824a0ab6324db6b75ce574'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.171579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ad7cf537824a0ab6324db6b75ce574'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.186870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ad7cf537824a0ab6324db6b75ce574'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.188767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ad7cf537824a0ab6324db6b75ce574'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.196750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b88f6e4e8f4758b59a5d7e90065963'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.198136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-79d8360f-2bfa-4848-b2fd-4d5fc1316324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ad7cf537824a0ab6324db6b75ce574'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.198718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b88f6e4e8f4758b59a5d7e90065963'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.209151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b88f6e4e8f4758b59a5d7e90065963'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.211480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 882/1762] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/users/70ad7cf537824a0ab6324db6b75ce574 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:59.212714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60d6-7d49-41dd-a4d3-0b70f5569d45 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.212992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60d6-7d49-41dd-a4d3-0b70f5569d45 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.213306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60d6-7d49-41dd-a4d3-0b70f5569d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.229281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b88f6e4e8f4758b59a5d7e90065963'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.233514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4bda60d6-7d49-41dd-a4d3-0b70f5569d45 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:59.234905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4bda60d6-7d49-41dd-a4d3-0b70f5569d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.236613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b88f6e4e8f4758b59a5d7e90065963'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.245085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 881/1763] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:42:58 2022] DELETE /identity/v3/users/58b88f6e4e8f4758b59a5d7e90065963 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:59.246828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:59.248133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.349102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 883/1764] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:59.351089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.354153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.354153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.354321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:59.376557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:59.376976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947ae9e-67c5-4989-af77-124760455be7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.378597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.386391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:59.387915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 884/1765] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:59.388830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.389344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.390940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] PATH_INFO: `/v3/projects/e5b421044c8741e194f5310e5e2cefba` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.392152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:59.393894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b421044c8741e194f5310e5e2cefba)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:59.395481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.400466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:59.438646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:42:59.478385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586c3f-1105-49c5-a86d-0213e56841ef None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.490219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:59.491518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.491933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.492936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.497377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.514362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b421044c8741e194f5310e5e2cefba', 'request_id': 'req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.546850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b421044c8741e194f5310e5e2cefba', 'request_id': 'req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.564452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b421044c8741e194f5310e5e2cefba', 'request_id': 'req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.594075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] The token cache is being invalidate because project e5b421044c8741e194f5310e5e2cefba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:42:59.594986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.595990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7bfb3c2c-cc83-4e26-95d2-b9f5c3d92b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:42:59.601066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 882/1766] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:42:59 2022] DELETE /identity/v3/projects/e5b421044c8741e194f5310e5e2cefba => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:42:59.602827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c9d0-109f-44c4-b742-0ca3137ffa1d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.603171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c9d0-109f-44c4-b742-0ca3137ffa1d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.603651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6c9d0-109f-44c4-b742-0ca3137ffa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.647258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1e6c9d0-109f-44c4-b742-0ca3137ffa1d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:59.648251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1e6c9d0-109f-44c4-b742-0ca3137ffa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.655497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:59.656975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:59.688537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 885/1767] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:42:59.692389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:59.699539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.789116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 883/1768] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:59.795987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.797890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.798170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.853557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:42:59.854840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:42:59.877059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49112d71-ce43-48b8-bf46-0bb6b093dee4 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.878241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 884/1769] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:42:59.879168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:42:59.901611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256931b-0ecb-480b-be27-769eb4d204e1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:42:59.915353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:42:59.916868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.916868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.916868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:42:59.918580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:42:59.918889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:42:59.924029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ec7c2-3c33-4fa4-9864-38cf722e784f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:42:59.949238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 885/1770] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:42:59.954168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:42:59.954449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:42:59.954791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.003051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:00.005509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.015554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.016366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.016746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.017225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.019144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 886/1771] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:00.021187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.021313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.034835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646e401-c6bb-4ed7-921d-d23a4f1eed52 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.041253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.041998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.042271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.042537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.043172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.045746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.053663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.055728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.081640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 886/1772] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:00.083034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.094162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ea554-1cae-4055-86e0-16fd40b63717 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.100054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.100852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.101530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.101731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.102565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:00.102947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.108830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.108931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 887/1773] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:00.108931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.108931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.120193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 887/1774] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:00.121267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.140468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af35d0-13e5-4cb6-91ac-1b0af317d83d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.201821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:00.206339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:00.263824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.264755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.265059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.265421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.267113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.269513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.270436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c599be-5d4a-4a02-8a23-f0f91ad82300 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.277780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.278651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.279192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.279599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] PATH_INFO: `/v3/projects/78fe8aeecfa54e209338f233ed52c0ab` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.281761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fe8aeecfa54e209338f233ed52c0ab)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.284238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.304761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 888/1775] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:00.305829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.318041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1d0f-d80d-4bbe-a8f3-5ec81411a518 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.325487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.326113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.326390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.326662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.327433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.329353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.379123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 889/1776] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:00.380473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.391510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fe8aeecfa54e209338f233ed52c0ab', 'request_id': 'req-41f1cbcd-974b-4f5a-93cb-3179187505a3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.403644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fe8aeecfa54e209338f233ed52c0ab', 'request_id': 'req-41f1cbcd-974b-4f5a-93cb-3179187505a3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.412001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fe8aeecfa54e209338f233ed52c0ab', 'request_id': 'req-41f1cbcd-974b-4f5a-93cb-3179187505a3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.427436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] The token cache is being invalidate because project 78fe8aeecfa54e209338f233ed52c0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:00.428682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.429409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.432365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 888/1777] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:00 2022] DELETE /identity/v3/projects/78fe8aeecfa54e209338f233ed52c0ab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:00.436624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.436624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.472632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de725f-f133-4a7e-be4d-8ea3a537f85b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.478718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.479528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.479896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.480647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.481119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.483557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae23cba-0cb3-47be-888e-331996ed9982 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.497205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 890/1778] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:00.502916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.503272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.503641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.530505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1cbcd-974b-4f5a-93cb-3179187505a3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.531810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:00.533256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.537361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.538660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.539323 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.539847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.541025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.543509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 891/1779] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:00.544325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.544436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.546066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.561473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b3ae0-28ca-49d2-b88e-7271867916dc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.571099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.571959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.572559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.572834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.573627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.575649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ad63a-dff3-44b3-8e0c-094c34367f10 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.579033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 889/1780] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:00.580068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.581985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.588780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 892/1781] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:00.590525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.590875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.591198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.598328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b4ed2-3d5b-49a2-a4e4-a0c9eb8fe2e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.604028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.604675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.604951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.605254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] PATH_INFO: `/v3/projects/b41189e4d8dc4426bfeffe43de13a9ba` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.606392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41189e4d8dc4426bfeffe43de13a9ba)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.608354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.612839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:00.614283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.627355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 893/1782] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:00.628345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.638326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760d5f3-58a0-4b50-a488-aa1420fce4ac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.646290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.647359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.647650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.647965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.648902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.651076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.664188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 894/1783] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:00.665850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.672003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:00.674181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41189e4d8dc4426bfeffe43de13a9ba', 'request_id': 'req-f550b316-c2e6-41a1-8346-b6849081ee8a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.679666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3c9b6-539a-44b1-b265-b089018381df admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.685988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41189e4d8dc4426bfeffe43de13a9ba', 'request_id': 'req-f550b316-c2e6-41a1-8346-b6849081ee8a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.694006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41189e4d8dc4426bfeffe43de13a9ba', 'request_id': 'req-f550b316-c2e6-41a1-8346-b6849081ee8a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.706380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] The token cache is being invalidate because project b41189e4d8dc4426bfeffe43de13a9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:00.706651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.707406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.709034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 890/1784] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:00 2022] DELETE /identity/v3/projects/b41189e4d8dc4426bfeffe43de13a9ba => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:00.709746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.713221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.744479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:00.749281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.750559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.751143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.751818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] PATH_INFO: `/v3/projects/cbd2a0ff017244268258e26139609ee0/users/b11af12088f449b386a5d72d400810e8/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.768637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd2a0ff017244268258e26139609ee0, user_id=b11af12088f449b386a5d72d400810e8, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.771454 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.783991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b316-c2e6-41a1-8346-b6849081ee8a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.789130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 895/1785] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:00 2022] PUT /identity/v3/projects/cbd2a0ff017244268258e26139609ee0/users/b11af12088f449b386a5d72d400810e8/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:00.790054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.791865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.847303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.847973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.848248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.848575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.849206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:00.849507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.851299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.863940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 891/1786] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:00.865097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:00.868271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.870034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c900-9a53-4a52-8cb1-3989c655f251 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.878029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.878674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.879158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.879438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.880078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.881256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f8c09-387b-4188-9d85-8ccc7838af94 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:00.881800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03075491-866c-484e-b5ad-2ee96463a197 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.885980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:00.886628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.886907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.887193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] PATH_INFO: `/v3/users/6cd9c163117e49b7a4f6c0b6137eec98` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.888459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd9c163117e49b7a4f6c0b6137eec98)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:00.890451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:00.892636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 896/1787] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:00.894096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:00.894383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:00.894753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:00.929576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] MFA Rules not processed for user `b11af12088f449b386a5d72d400810e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:00.930906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:00.961098 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd9c163117e49b7a4f6c0b6137eec98'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.961744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd9c163117e49b7a4f6c0b6137eec98'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.971969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd9c163117e49b7a4f6c0b6137eec98'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.987016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd9c163117e49b7a4f6c0b6137eec98'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:00.988518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:00.998467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd9c163117e49b7a4f6c0b6137eec98'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:01.013782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 892/1788] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:00 2022] DELETE /identity/v3/users/6cd9c163117e49b7a4f6c0b6137eec98 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:01.016693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 897/1789] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:01.017570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.018663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.025213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:01.032193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fee0b-d5a2-4cab-9913-195889f63b84 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.120445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.121366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.122134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.122495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] PATH_INFO: `/v3/projects/2b918666422547c9bc4252473ae39330/users/9123c627653d4f43ac08cd56e6c2976e/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.147578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:01.155817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b918666422547c9bc4252473ae39330, user_id=9123c627653d4f43ac08cd56e6c2976e, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.164295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.179702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4aee-7d08-457a-b467-22555dd9d410 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.186901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.187524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.187801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.188063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.188968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.190807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa63f5-148d-4053-81bf-84bc450dabd2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.202497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 898/1790] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:01 2022] PUT /identity/v3/projects/2b918666422547c9bc4252473ae39330/users/9123c627653d4f43ac08cd56e6c2976e/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:01.207859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.210398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:01.244191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 893/1791] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:01 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:01.245880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.246127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.246570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.323168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] MFA Rules not processed for user `9123c627653d4f43ac08cd56e6c2976e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:01.326573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:01.347928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c57088-8acb-442f-9adf-b103bc3d531a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.434275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.435148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.435606 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.436053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.438424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:01.519929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.520627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 894/1792] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:01.522376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.522999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.541210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 899/1793] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:01.548362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.552592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:01.582048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929ace1-cb58-4bd7-8a41-3db4c043dbf9 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.592440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.593748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.594983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.595626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.617718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.621299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab48f88-d5d9-410e-bb60-aee4c202c324 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.627575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.628284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.628625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.629007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.630432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.632693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.633403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.648234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:01.668212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 900/1794] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:01.692239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 895/1795] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:01 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:01.696729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.736883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d7ec-c5cb-418a-81ba-b63138a6a705 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.749526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.750155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.750780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.751052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.751706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.756357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.783661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.784263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 901/1796] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:01.798864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096e09b-ea03-430e-8692-808639ba27be admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.813730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.813967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.814174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.814426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.815183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.816959 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c0762-a738-456d-88cc-a582268435f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.841903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 896/1797] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:01.845979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:01.861421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610618c-4f17-46ce-8066-a62e06166a28 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:01.869698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:01.872270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.872554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.872840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] PATH_INFO: `/v3/projects/5a1ea55a6aba467985df219eb9777d79/users/a6c11fba269b47fca384c7acb06238e5/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.898408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1ea55a6aba467985df219eb9777d79, user_id=a6c11fba269b47fca384c7acb06238e5, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:01.903887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:01.937101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 902/1798] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:01 2022] PUT /identity/v3/projects/5a1ea55a6aba467985df219eb9777d79/users/a6c11fba269b47fca384c7acb06238e5/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:01.948171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:01.948949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:01.949312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:01.989893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] MFA Rules not processed for user `a6c11fba269b47fca384c7acb06238e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:01.991198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:02.119786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:02.122605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:02.123717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 897/1799] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:02.146494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:02.154493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:02.155454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:02.246326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa922e6-789f-4ccd-b7c0-ede641a36baa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:02.250480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:02.251168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.251380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.251653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] PATH_INFO: `/v3/projects/abbad021e87b4db7af820e5237a93259` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.252944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbad021e87b4db7af820e5237a93259)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:02.254932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:02.282274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81455f88-e25e-4d07-a010-6923f68e94ed None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:02.286295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:02.286972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.287249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.287514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.299644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:02.301390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83cd1c-5976-4650-83b6-52bf009a2633 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:02.321187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 898/1800] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:02.330848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbad021e87b4db7af820e5237a93259', 'request_id': 'req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:02.343956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbad021e87b4db7af820e5237a93259', 'request_id': 'req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:02.351360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbad021e87b4db7af820e5237a93259', 'request_id': 'req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:02.366090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] The token cache is being invalidate because project abbad021e87b4db7af820e5237a93259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:02.366427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:02.367111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d8fb320c-7399-49dc-a08a-21dd35f3a1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:02.373085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 903/1801] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:02 2022] DELETE /identity/v3/projects/abbad021e87b4db7af820e5237a93259 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:02.374740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.375077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.375356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.402489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:02.403928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:02.505127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:02.527216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 899/1802] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:02.535609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.535885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.536150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.573098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:02.586402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:02.595061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 904/1803] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:02.600007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:02.620710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926cb57-7fe8-4b06-8962-14dd4def7747 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:02.630048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:02.630699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.630976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.631246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.632181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:02.632485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:02.634195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:02.653260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 900/1804] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:02.654461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:02.672185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d888b-89ad-4414-a872-de62eb8e9296 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:02.685448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:02.686804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.688747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.689044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.689938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:02.692073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:02.755630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 905/1805] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:02 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:02.760771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:02.804973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ee2c7-9aef-4a64-a975-fa5356eacb83 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:02.938131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:02.939161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:02.939713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:02.940100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:02.940936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:02.960103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.016174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 901/1806] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:02 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:03.019780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.041729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb7b7f-9ee8-4d0b-af6f-92eca03f9c89 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.065532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.066210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.066809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.067091 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.067757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.070487 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.105089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 906/1807] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:03.111404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.125125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13151e-a531-460c-8b6c-5b3f9afb86fa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.130232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.130990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.131268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.131536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.132211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.133960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb0ea-e963-494f-9338-07993efe432f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.145455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 902/1808] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:03.149871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.160675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dc84d-b566-48df-8ac6-9ff3519ada12 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.166096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.166755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.167130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.167360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] PATH_INFO: `/v3/projects/8e5e4b387bec446096efc3de42d62933/users/deef27d1b516480ea27ffd649707d416/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.184924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5e4b387bec446096efc3de42d62933, user_id=deef27d1b516480ea27ffd649707d416, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.187662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.227579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 907/1809] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:03 2022] PUT /identity/v3/projects/8e5e4b387bec446096efc3de42d62933/users/deef27d1b516480ea27ffd649707d416/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:03.239852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe151-112a-4203-82b7-4936450887c1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.240222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe151-112a-4203-82b7-4936450887c1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.240556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe151-112a-4203-82b7-4936450887c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.303468 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-015fe151-112a-4203-82b7-4936450887c1 None None] MFA Rules not processed for user `deef27d1b516480ea27ffd649707d416`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:03.305455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-015fe151-112a-4203-82b7-4936450887c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:03.422065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 903/1810] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:03.425588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.479936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.515678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720575d-228a-4eca-8b17-51045b278633 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.522871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.523896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.524235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.524443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.525440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.527457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.568572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 908/1811] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:03 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:03.571100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe151-112a-4203-82b7-4936450887c1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.585603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe151-112a-4203-82b7-4936450887c1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.644707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:03.657234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.657513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.657819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.658672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.659404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.661974 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.694384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 904/1812] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:03 2022] POST /identity/v3/users => generated 303 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:03.698601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.714200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9e97d-7055-4f45-bc3e-33eae4adeca0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.720700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.721617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.721896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.722179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.722910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.724833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.738679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 909/1813] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:03.744163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.757504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592d06-8186-4bb5-8423-f82aecef3cee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.764569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.765695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.765963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.766236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] PATH_INFO: `/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61/users/0c884bfb65da4e7d967e58ff4b86a93f/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.787354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a8f49fe19e4fd48fd147f5a7ca8c61, user_id=0c884bfb65da4e7d967e58ff4b86a93f, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.791800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.810530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 905/1814] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:03 2022] PUT /identity/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61/users/0c884bfb65da4e7d967e58ff4b86a93f/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:03.815267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.828878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ebd61-e8e8-4310-9ec7-38f5cb0792c8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.903234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.903922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.904204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.904475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.905164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.906886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41084b6-abc8-4bce-bba4-e362a57a4a32 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.919855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 910/1815] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:03.923671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:03.935252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7651a-7546-4025-8ead-3789e0ade521 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:03.940202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:03.940878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.941187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.941497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] PATH_INFO: `/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61/users/0c884bfb65da4e7d967e58ff4b86a93f/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:03.943692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a8f49fe19e4fd48fd147f5a7ca8c61, user_id=0c884bfb65da4e7d967e58ff4b86a93f, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:03.947366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:03.960327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 906/1816] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:03 2022] PUT /identity/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61/users/0c884bfb65da4e7d967e58ff4b86a93f/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:03.971294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:03.971575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:03.971844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.004157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] MFA Rules not processed for user `0c884bfb65da4e7d967e58ff4b86a93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:04.005413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.077643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 911/1817] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:04.089260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:04.106606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.164750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:04.166189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.171710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668acf3-5833-4d19-911b-368892a09902 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:04.175687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:04.176329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:04.176602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:04.176866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.186028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:04.187464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:04.196880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 907/1818] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:04 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:04.202989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:04.235576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aac66-a9d1-4ae0-9a90-95c0f7fba5ed None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:04.245075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:04.245863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:04.246143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:04.246411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] PATH_INFO: `/v3/users/2e9e3610fe0c47089d718dc378b530b9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.247574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9e3610fe0c47089d718dc378b530b9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:04.249671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:04.250046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:04.251480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.263282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb55b8-bb0a-4606-bfb9-bcbab56e935f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:04.270002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:04.270002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:04.270258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:04.270427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.309483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9e3610fe0c47089d718dc378b530b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:04.319288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9e3610fe0c47089d718dc378b530b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:04.335545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9e3610fe0c47089d718dc378b530b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:04.336528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9e3610fe0c47089d718dc378b530b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:04.359044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4db0a447-55b2-4e00-b46e-e05f2daf2ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9e3610fe0c47089d718dc378b530b9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:04.366907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 912/1819] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:04 2022] DELETE /identity/v3/users/2e9e3610fe0c47089d718dc378b530b9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:04.369939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:04.372097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:04.374343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:04.374627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.381194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:04.399468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:04.400987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.407508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 908/1820] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:04.471543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 913/1821] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:04.485617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:04.487732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:04.611840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:04.628076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e77c94-b84c-4275-a4ee-ba84908ecd41 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:04.687699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:04.688369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:04.688645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:04.689041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:04.700330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:04.701950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:04.713414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 909/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:05.031646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:05.033300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:05.054671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cd8a4-20d3-448f-aaee-b13e44677b90 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:05.071956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:05.072663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:05.072886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:05.073206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] PATH_INFO: `/v3/projects/951fbd94d2174aa5b60f853c73125993` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:05.074356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951fbd94d2174aa5b60f853c73125993)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:05.076630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:05.139722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:05.141486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951fbd94d2174aa5b60f853c73125993', 'request_id': 'req-3985b03d-c6e5-4b50-800d-394ebf03fa90'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.154825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951fbd94d2174aa5b60f853c73125993', 'request_id': 'req-3985b03d-c6e5-4b50-800d-394ebf03fa90'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.173659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951fbd94d2174aa5b60f853c73125993', 'request_id': 'req-3985b03d-c6e5-4b50-800d-394ebf03fa90'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.225183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] The token cache is being invalidate because project 951fbd94d2174aa5b60f853c73125993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:05.225684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.227149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.229391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 914/1823] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:05 2022] DELETE /identity/v3/projects/951fbd94d2174aa5b60f853c73125993 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:05.240026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:05.263073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e105-36f9-47eb-9043-6cbe78290094 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:05.354563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:05.355964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:05.356428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:05.356760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] PATH_INFO: `/v3/users/fdb2865413e841c29661fa5918d37811` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:05.373641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb2865413e841c29661fa5918d37811)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:05.375757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:05.427910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb2865413e841c29661fa5918d37811'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.428546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb2865413e841c29661fa5918d37811'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.437040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb2865413e841c29661fa5918d37811'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.449802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb2865413e841c29661fa5918d37811'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.458143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb2865413e841c29661fa5918d37811'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.464625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 910/1824] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:05 2022] DELETE /identity/v3/users/fdb2865413e841c29661fa5918d37811 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:05.742618 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:05.744043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:05.761679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985b03d-c6e5-4b50-800d-394ebf03fa90 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:05.829717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:05.831068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:05.831350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:05.831648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] PATH_INFO: `/v3/projects/a3c9427aea8740c7b74ca6370c4ed057` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:05.832866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c9427aea8740c7b74ca6370c4ed057)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:05.842514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:05.905745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c9427aea8740c7b74ca6370c4ed057', 'request_id': 'req-3277dfb5-69ce-4f93-b266-fd5e702929df'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.916224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c9427aea8740c7b74ca6370c4ed057', 'request_id': 'req-3277dfb5-69ce-4f93-b266-fd5e702929df'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.923999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c9427aea8740c7b74ca6370c4ed057', 'request_id': 'req-3277dfb5-69ce-4f93-b266-fd5e702929df'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.937138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] The token cache is being invalidate because project a3c9427aea8740c7b74ca6370c4ed057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:05.937426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.938106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:05.939710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 915/1825] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:05 2022] DELETE /identity/v3/projects/a3c9427aea8740c7b74ca6370c4ed057 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:05.945561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:05.948062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:05.971607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efeaa8-665c-4f22-aa09-3546a5597a1c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:06.001165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:06.044505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:06.045179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:06.045455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:06.045722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] PATH_INFO: `/v3/users/5737e49abd3140aa90d85469b5baa729` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:06.046864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5737e49abd3140aa90d85469b5baa729)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:06.048771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:06.098104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5737e49abd3140aa90d85469b5baa729'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.098815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5737e49abd3140aa90d85469b5baa729'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.107354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5737e49abd3140aa90d85469b5baa729'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.119698 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5737e49abd3140aa90d85469b5baa729'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.127558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7135b4cf-7ac2-443d-bda6-ed02acde959d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5737e49abd3140aa90d85469b5baa729'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.133657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 911/1826] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:05 2022] DELETE /identity/v3/users/5737e49abd3140aa90d85469b5baa729 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:06.505825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:06.509013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:06.527496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277dfb5-69ce-4f93-b266-fd5e702929df admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:06.641273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:06.641931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:06.642212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:06.642500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] PATH_INFO: `/v3/projects/d5ad68b506714e119f57f8c3d12ae411` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:06.643647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ad68b506714e119f57f8c3d12ae411)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:06.645749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:06.655299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:06.721273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ad68b506714e119f57f8c3d12ae411', 'request_id': 'req-3c2633d9-2541-40cb-a892-8776c699e1f3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.738647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ad68b506714e119f57f8c3d12ae411', 'request_id': 'req-3c2633d9-2541-40cb-a892-8776c699e1f3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.745166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ad68b506714e119f57f8c3d12ae411', 'request_id': 'req-3c2633d9-2541-40cb-a892-8776c699e1f3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.780063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] The token cache is being invalidate because project d5ad68b506714e119f57f8c3d12ae411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:06.780347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.781838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c2633d9-2541-40cb-a892-8776c699e1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:06.783514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 916/1827] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:06 2022] DELETE /identity/v3/projects/d5ad68b506714e119f57f8c3d12ae411 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:06.798659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:06.798943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:06.799219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:06.822511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:06.824131 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:06.911690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 912/1828] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:06.923087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:06.923665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:06.924112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:06.965544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:06.966857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:06.976338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 917/1829] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:06.980515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:06.991707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c34d2-be6b-499d-ade7-412b06361cf5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.008379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.009856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.010202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.010549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.011321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:07.011749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.013594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.029861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 913/1830] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:07.034980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.045594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f943f4-2ce6-4b0a-b66c-36e671857825 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.053254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.053254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.053254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.053254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.054083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.056383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.093337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 918/1831] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:07.095625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.106242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111cb8-fc33-4c51-b9dd-37b0aade37ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.133997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:07.170208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.170848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.171100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.171365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.171995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.173966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.201190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 914/1832] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:07.202489 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.221991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231126-7af1-4bb4-98b6-7f896d8f53aa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.221991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.221991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.221991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.222344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.222344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.222344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.233260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 919/1833] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:07.236989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.247134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab695b-7cd7-45c8-ba3d-83bd20c7d6f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.251887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.252511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.252750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.253034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.253695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.255422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badfdbd-f9e7-4dd8-a420-9005a5b74d10 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.265530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 915/1834] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:07.270040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.280386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606314-47cb-4639-830c-9b44f3a343b2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.285642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.286559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.286811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.287098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] PATH_INFO: `/v3/projects/19ccc8c9f76c4d58ba66ae57df29da46/users/80553be76789443fadf245ebd9fe2fb6/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.304700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ccc8c9f76c4d58ba66ae57df29da46, user_id=80553be76789443fadf245ebd9fe2fb6, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.307404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.323950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 920/1835] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:07 2022] PUT /identity/v3/projects/19ccc8c9f76c4d58ba66ae57df29da46/users/80553be76789443fadf245ebd9fe2fb6/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:07.335210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.335439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.335736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.364050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] MFA Rules not processed for user `80553be76789443fadf245ebd9fe2fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:07.365281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:07.438426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 916/1836] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:07.445787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.514796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c471b44-61e2-4b8a-9265-dfa7faee37e6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.520406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.521284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.521843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.522314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.523290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.525574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.557045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 921/1837] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:07.560613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.578596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011674a8-cae9-4241-9a71-c8cccfdcec45 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.644316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.645014 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.645295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.645560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.646735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.648435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.673376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 917/1838] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:07.677555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.688817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ab06d-0639-48cc-baae-2269708f0992 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.699476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.700721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.701115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.701446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.702159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.703949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.717042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 922/1839] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:07.719930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.729961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca591e-5733-42dd-9c3a-aa13377ec3c8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.735933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.736531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.736799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.737105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.737775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.739488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30356d22-f06c-4f28-ba4a-b9fdfb59b537 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.752380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 918/1840] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:07.753590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:07.764477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51265-281f-40e4-ae78-97b106af2481 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:07.770300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:07.770964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.771257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.771517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] PATH_INFO: `/v3/projects/c0fdaa48ef46490f97a01bf18afc8afc/users/596b6b52d5974da1b40ce5fdb27427aa/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.774087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:07.789317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fdaa48ef46490f97a01bf18afc8afc, user_id=596b6b52d5974da1b40ce5fdb27427aa, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:07.792003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:07.806124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 923/1841] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:07 2022] PUT /identity/v3/projects/c0fdaa48ef46490f97a01bf18afc8afc/users/596b6b52d5974da1b40ce5fdb27427aa/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:07.816871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:07.817255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:07.817544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:07.854685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] MFA Rules not processed for user `596b6b52d5974da1b40ce5fdb27427aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:07.856026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:07.860215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:07.951041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 919/1842] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:07.955595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.028046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b707-71ce-4c02-9890-8a5cca6be018 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.033576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.038443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.039226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.039716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.040733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.043142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.085997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 924/1843] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:07 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:08.087357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.106604 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76bf6-9b4c-4901-a242-38ec744d3f47 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.108982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.114613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.215138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.216388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.216917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.217290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.218140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.222870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.224016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119b90d-cb12-4a38-ba9c-350d2afbb3c7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.230829 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.231535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.232525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.232816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] PATH_INFO: `/v3/users/deef27d1b516480ea27ffd649707d416` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.234212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deef27d1b516480ea27ffd649707d416)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.237930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.253915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 920/1844] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:08 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:08.258048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.270074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df83bc-f618-4b12-a50a-25f391034681 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.275837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.276476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.276751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.277036 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.277763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.279546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.291100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 921/1845] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:08.295460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.304972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deef27d1b516480ea27ffd649707d416'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:08.307201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc637918-1423-4138-8902-adcea6bc6259 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.312656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.313436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.313697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.313917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] PATH_INFO: `/v3/projects/ec631a67729d4f89841f7f724c787156/users/b8f1ca62c31144b19afe6f96f9dbbc7e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.317747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deef27d1b516480ea27ffd649707d416'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:08.333527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:08.334780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deef27d1b516480ea27ffd649707d416'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:08.335807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deef27d1b516480ea27ffd649707d416'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:08.340579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec631a67729d4f89841f7f724c787156, user_id=b8f1ca62c31144b19afe6f96f9dbbc7e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.343843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.345038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff183425-56eb-427b-80ee-6f5a596dfdf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deef27d1b516480ea27ffd649707d416'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:08.354254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 925/1846] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:08 2022] DELETE /identity/v3/users/deef27d1b516480ea27ffd649707d416 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:08.360103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.361047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.361354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.368434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 922/1847] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:08 2022] PUT /identity/v3/projects/ec631a67729d4f89841f7f724c787156/users/b8f1ca62c31144b19afe6f96f9dbbc7e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:08.373680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.376151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.388165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:08.388165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.467496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3644-360d-444c-85fd-f4dd72f8bb81 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.472442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.473151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.473430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.473703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.474605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.476507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.478425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:08.498185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 923/1848] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:08.503588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 926/1849] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:08.503812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.511259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.512732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.519191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772da91-f44b-4bf0-9af0-e41d44ca825b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.530523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.531136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.531411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.531682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] PATH_INFO: `/v3/projects/ec631a67729d4f89841f7f724c787156/users/b8f1ca62c31144b19afe6f96f9dbbc7e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.534088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec631a67729d4f89841f7f724c787156, user_id=b8f1ca62c31144b19afe6f96f9dbbc7e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.536810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed5bc-44d8-4234-b01c-e506f20f589d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.552521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 924/1850] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:08 2022] PUT /identity/v3/projects/ec631a67729d4f89841f7f724c787156/users/b8f1ca62c31144b19afe6f96f9dbbc7e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:08.564655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.564966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.565249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.618994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f8f77-d6c8-4794-920c-4745c1a847af None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.619594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] MFA Rules not processed for user `b8f1ca62c31144b19afe6f96f9dbbc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:08.620685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.684905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.685899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.686374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.686830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.725526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 925/1851] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:08.737908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:08.740732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.771768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:08.776839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.778985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.791870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 927/1852] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:08.825216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5508-7f55-48b9-aca3-7bbdf140fec3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:08.829854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:08.830790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:08.831136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:08.831472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:08.833564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:08.922017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:08.923994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:08.935611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 926/1853] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:09.683411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:09.685474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:09.717433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964f14-cbe6-49de-8ab4-abacbcf1b3c4 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:09.722122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:09.722792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:09.723062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:09.723322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] PATH_INFO: `/v3/projects/8e5e4b387bec446096efc3de42d62933` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:09.724427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5e4b387bec446096efc3de42d62933)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:09.726358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:09.778463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5e4b387bec446096efc3de42d62933', 'request_id': 'req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.785398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5e4b387bec446096efc3de42d62933', 'request_id': 'req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.791186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5e4b387bec446096efc3de42d62933', 'request_id': 'req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.802277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] The token cache is being invalidate because project 8e5e4b387bec446096efc3de42d62933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:09.802639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.803375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.804953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 928/1854] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:09 2022] DELETE /identity/v3/projects/8e5e4b387bec446096efc3de42d62933 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:09.808977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:09.820580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa386-3f42-463b-b0dc-80987528d86b service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:09.840799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:09.894983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:09.895996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:09.895996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:09.896221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] PATH_INFO: `/v3/users/0c884bfb65da4e7d967e58ff4b86a93f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:09.897469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c884bfb65da4e7d967e58ff4b86a93f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:09.900084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:09.971470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c884bfb65da4e7d967e58ff4b86a93f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.972218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c884bfb65da4e7d967e58ff4b86a93f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.983201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c884bfb65da4e7d967e58ff4b86a93f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:09.997836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c884bfb65da4e7d967e58ff4b86a93f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.006340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ec1f2aa9-08f6-43f7-9e9a-d8345475034b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c884bfb65da4e7d967e58ff4b86a93f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.012833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 927/1855] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:09 2022] DELETE /identity/v3/users/0c884bfb65da4e7d967e58ff4b86a93f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:10.431936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:10.434225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:10.454859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54aad9-bcd3-4bcf-a847-7f82e10d720e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:10.559320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:10.560342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:10.560857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:10.561766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] PATH_INFO: `/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:10.563446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a8f49fe19e4fd48fd147f5a7ca8c61)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:10.568324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:10.652377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a8f49fe19e4fd48fd147f5a7ca8c61', 'request_id': 'req-053bfd81-f818-480b-a1f5-d4b06d15e6e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.658030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a8f49fe19e4fd48fd147f5a7ca8c61', 'request_id': 'req-053bfd81-f818-480b-a1f5-d4b06d15e6e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.673250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a8f49fe19e4fd48fd147f5a7ca8c61', 'request_id': 'req-053bfd81-f818-480b-a1f5-d4b06d15e6e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.707026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] The token cache is being invalidate because project a2a8f49fe19e4fd48fd147f5a7ca8c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:10.707946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.709855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:10.718801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 929/1856] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:10 2022] DELETE /identity/v3/projects/a2a8f49fe19e4fd48fd147f5a7ca8c61 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:10.719874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a529-2a64-4cd2-afc0-f0ead82e88cd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:10.720168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a529-2a64-4cd2-afc0-f0ead82e88cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:10.720629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a529-2a64-4cd2-afc0-f0ead82e88cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:10.773755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ae74a529-2a64-4cd2-afc0-f0ead82e88cd None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:10.778069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ae74a529-2a64-4cd2-afc0-f0ead82e88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:10.917978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 928/1857] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:10.928069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:10.929852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:10.941784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:10.946314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:10.946750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:10.961575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:10.990846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:10.993603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:11.021600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bfd81-f818-480b-a1f5-d4b06d15e6e4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.026545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.027187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.027496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.027836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.029785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:11.040135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 929/1858] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:11.041189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.054900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aa350-97aa-4117-9b89-701485d23442 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.059318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.059943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.060272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.060546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.061239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:11.061537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.063382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.084905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 930/1859] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:11.089178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.104150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32937bd3-4c3b-48cf-982d-88a935c65818 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.111234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.114774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.115111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.115526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.116228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.118420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.128306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.133633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.144141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 930/1860] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:11.155266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:11.165850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 931/1861] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:11 2022] POST /identity/v3/projects => generated 407 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:11.170229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.184410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0a90-a4df-4488-8982-793a2f7c8684 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.266543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.267245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.267608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.267919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.268664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.270770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.309071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 931/1862] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:11 2022] POST /identity/v3/users => generated 304 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:11.314226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.326855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d225b-2259-49be-95eb-31bdb3e007f5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.332308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.333053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.333389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.333646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.334452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.336114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.349047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 932/1863] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:11.351339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.362656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc27ac-c0c1-45ce-a991-ae16e8777a2f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.368187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.368805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.369369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.369584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.370211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.371796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5514-4c4f-4f32-872a-831ba90df51e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.389513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 932/1864] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:11.390657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.402552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ce043-79ad-462f-80f7-5cee2c4597a5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.409121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.409795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.410096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.410507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] PATH_INFO: `/v3/projects/d3c99982b8ce421aa58a0459bd25d024/users/9f033e9b611d4d7591b7ece1c6c2254c/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.432176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c99982b8ce421aa58a0459bd25d024, user_id=9f033e9b611d4d7591b7ece1c6c2254c, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.435440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.453348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 933/1865] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:11 2022] PUT /identity/v3/projects/d3c99982b8ce421aa58a0459bd25d024/users/9f033e9b611d4d7591b7ece1c6c2254c/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:11.463642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.463927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.464189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.497212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] MFA Rules not processed for user `9f033e9b611d4d7591b7ece1c6c2254c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:11.498550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:11.537852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:11.596117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 933/1866] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:11 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:11.596387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.704689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290830-4f13-4af1-a567-4d558e1bf4e8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.713935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.718954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.719297 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.719619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.720650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.723051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.779486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 934/1867] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:11 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:11.783952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.797475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a723d34-7853-4c98-a74e-9ab89ab5c323 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.896653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.897359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.897630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.897931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.898576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.900490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.933050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 934/1868] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:11 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:11.935733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.948586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca790a-1968-4f8b-8ad7-98c7376dec24 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.955090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.955856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:11.956144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:11.956664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:11.957617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:11.959445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:11.960077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.974539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 935/1869] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:11.978673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:11.991666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa88038-7da0-403b-89a0-71af1a881871 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:11.997922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:11.998853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.014284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.014720 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] PATH_INFO: `/v3/projects/671288562a43434f9cc588be63062806/users/461bfd8fa3f046eaa83f9679612d5003/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.022642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deef3d-c874-49d8-a4b2-02b21196e627 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:12.027149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:12.027772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.028043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.028729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.030795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:12.036431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=671288562a43434f9cc588be63062806, user_id=461bfd8fa3f046eaa83f9679612d5003, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.039851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:12.062964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 936/1870] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:11 2022] PUT /identity/v3/projects/671288562a43434f9cc588be63062806/users/461bfd8fa3f046eaa83f9679612d5003/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:12.067981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:12.160783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.164890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:12.179665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ba04-f4c3-4639-b341-177f0048ec1a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:12.185406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:12.186090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.186365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.186638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.187576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.189764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a5fcc-afa1-4d5b-a719-4b474f885318 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:12.195427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 935/1871] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:12.207883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:12.214354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 937/1872] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:12.237887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad638cec-8bd5-4cc6-ac34-7cea8ae70f27 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:12.244736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:12.246077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.247363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.247656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] PATH_INFO: `/v3/projects/671288562a43434f9cc588be63062806/users/461bfd8fa3f046eaa83f9679612d5003/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.251939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=671288562a43434f9cc588be63062806, user_id=461bfd8fa3f046eaa83f9679612d5003, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.255020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:12.258851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:12.292700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 936/1873] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:12 2022] PUT /identity/v3/projects/671288562a43434f9cc588be63062806/users/461bfd8fa3f046eaa83f9679612d5003/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:12.305854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.306473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.306473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.350045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:12.368968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] MFA Rules not processed for user `461bfd8fa3f046eaa83f9679612d5003`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:12.370771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:12.469850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 938/1874] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:12 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:12.481425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:12.483448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:12.579935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358257-62f2-43ed-9cff-3308223781ee admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:12.584568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:12.584866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.585196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.585464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.599554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.601744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:12.613563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 937/1875] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:12 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:12.866430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:12.879164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcd055-b4e2-43ab-ac98-5bf9b788c547 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:12.884242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:12.884977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:12.885395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:12.885728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:12.917797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:12.920341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:12.975522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:12.978071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:13.013560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 939/1876] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:12 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:13.022457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:13.024573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.032442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992b6e6-469d-4fa7-b7ff-5c37e149010f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:13.037342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:13.037996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.038260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.038520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] PATH_INFO: `/v3/users/b11af12088f449b386a5d72d400810e8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.039630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11af12088f449b386a5d72d400810e8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:13.041784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:13.050412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa08d4-7c6f-4615-b2f0-6c0b8b740165 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:13.061195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:13.061850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.062121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.062387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] PATH_INFO: `/v3/users/1daca405d28e422fbd42411ffd7d26d8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.066185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1daca405d28e422fbd42411ffd7d26d8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:13.069097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:13.106231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11af12088f449b386a5d72d400810e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.114695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11af12088f449b386a5d72d400810e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.128867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11af12088f449b386a5d72d400810e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.129892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11af12088f449b386a5d72d400810e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.137808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-69c178c0-9925-43d7-9f57-51547ee961dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11af12088f449b386a5d72d400810e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.144385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 938/1877] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:12 2022] DELETE /identity/v3/users/b11af12088f449b386a5d72d400810e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:13.149097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.149376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.149642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.154356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1daca405d28e422fbd42411ffd7d26d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.155193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1daca405d28e422fbd42411ffd7d26d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.163953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1daca405d28e422fbd42411ffd7d26d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.171423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:13.172750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.179522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1daca405d28e422fbd42411ffd7d26d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.188323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:13.192153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1daca405d28e422fbd42411ffd7d26d8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.201533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 940/1878] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:13 2022] DELETE /identity/v3/users/1daca405d28e422fbd42411ffd7d26d8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:13.269083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 939/1879] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:13.287266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:13.289338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.306344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:13.410932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c514377-7632-4853-b4f1-32e6084cb747 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:13.416846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:13.417508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.417781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.418046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.530843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:13.532445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.552422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:13.554162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1a47-f682-4528-9e73-e7a9caaca9f6 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:13.592206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 941/1880] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:13.603735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a893b4-7ebe-4e9d-86e4-21992018eb83 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:13.614199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:13.614859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.615136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.615405 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] PATH_INFO: `/v3/projects/a2aada1700df4e9ea29cd3e7044d61b3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.616879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2aada1700df4e9ea29cd3e7044d61b3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:13.620273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:13.703178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2aada1700df4e9ea29cd3e7044d61b3', 'request_id': 'req-e3b9320e-0e47-4852-922b-95032f3b2ddc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.714094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2aada1700df4e9ea29cd3e7044d61b3', 'request_id': 'req-e3b9320e-0e47-4852-922b-95032f3b2ddc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.735758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2aada1700df4e9ea29cd3e7044d61b3', 'request_id': 'req-e3b9320e-0e47-4852-922b-95032f3b2ddc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.753555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] The token cache is being invalidate because project a2aada1700df4e9ea29cd3e7044d61b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:13.753909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.755035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e3b9320e-0e47-4852-922b-95032f3b2ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:13.757765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 940/1881] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:13 2022] DELETE /identity/v3/projects/a2aada1700df4e9ea29cd3e7044d61b3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:13.763025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.763888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.763888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.794080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:13.796126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.908301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 942/1882] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:13.925103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:13.925103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:13.925103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:13.959902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:13.965416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:13.995474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 941/1883] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:13.999843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.011833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0886b-7684-4508-8488-20cc41a6e681 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.017741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.019451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.030232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.031263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.031647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.032039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.032866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:14.040652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.041642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e2269-7c4f-4150-aad0-319ea7001735 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.042840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.058034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.058785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.059141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.059512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] PATH_INFO: `/v3/projects/cbd2a0ff017244268258e26139609ee0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.061612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 943/1884] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:14.064918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd2a0ff017244268258e26139609ee0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.066358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.069862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.080947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33ebb1-6c54-40dc-9db0-79621db4b603 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.089726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.090578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.090955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.091270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.092001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.094106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.133182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 944/1885] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:14.134926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd2a0ff017244268258e26139609ee0', 'request_id': 'req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:14.137361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.146510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd2a0ff017244268258e26139609ee0', 'request_id': 'req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:14.154545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd2a0ff017244268258e26139609ee0', 'request_id': 'req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:14.166581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:14.168346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] The token cache is being invalidate because project cbd2a0ff017244268258e26139609ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:14.168738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:14.169537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e8dfb5c6-6f2d-4f4c-b1ca-14ff749c1021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:14.171668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 942/1886] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:14 2022] DELETE /identity/v3/projects/cbd2a0ff017244268258e26139609ee0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:14.177841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095f96-4245-4cbd-bdd4-8e241ba2c892 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.178198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095f96-4245-4cbd-bdd4-8e241ba2c892 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.178538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095f96-4245-4cbd-bdd4-8e241ba2c892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.199687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-96095f96-4245-4cbd-bdd4-8e241ba2c892 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:14.201573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96095f96-4245-4cbd-bdd4-8e241ba2c892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.211108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7aa62-750e-4e01-bcb5-6ac4eb2b2c6b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.212413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 943/1887] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:14.216697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.217401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.217741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.218076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.218788 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.220280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.220565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.220830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.220923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.242063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:14.243186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.248694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 945/1888] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:14.249751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.251380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.252098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 944/1889] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:14.255785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.261719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:14.265887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385936-9a79-4379-927f-04b2fdcb4ab7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.266040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ee6b1-a764-432c-ba2f-61115bd1dcaf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.271274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.271711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.272126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.272408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.273157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.273495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.274388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.274971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.275101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.275659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.276818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:14.277242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.278916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.286348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 946/1890] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:14.290420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.293229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 945/1891] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:43:14.298075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.305361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c140aa-d8d3-4356-933a-ba70caba86f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.309546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958535-9e40-43a1-a3f9-3a3f3ebaa8f1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.310515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.311122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.311403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.311674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.312312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.313935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.314493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.315090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.315363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.315627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.316298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.318203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.326418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 947/1892] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:14.330518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.340718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4379b-0184-4c6b-b46d-c94002dad73c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.345447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.346286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.346398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 946/1893] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:14.346513 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.346629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] PATH_INFO: `/v3/projects/d0db9f400b4f429fbcf4c4052ede9b09/users/263600e8ce344a818a71400bb9c5dc37/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.350407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.363127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0db9f400b4f429fbcf4c4052ede9b09, user_id=263600e8ce344a818a71400bb9c5dc37, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.365963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586a53e-f168-4109-b37f-6cd5a4b74150 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.379677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 948/1894] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:14 2022] PUT /identity/v3/projects/d0db9f400b4f429fbcf4c4052ede9b09/users/263600e8ce344a818a71400bb9c5dc37/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:14.384957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.385117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.385351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.404332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:14.405657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.414688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641a978-1187-4ad1-a52c-0b449723d126 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.468596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 949/1895] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:14.478090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.478716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.479006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.479297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.479920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.480502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.481855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.482370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.516160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 947/1896] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:14.520699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.532549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1497-683d-42e7-b0ca-ddc9a1d0dfc6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.537895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.538730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.539006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.539273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.539908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.541562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.544003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ac886-2736-4746-b902-12db1abb4a6a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.547733 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.548377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.548687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.548955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.551698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 948/1897] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:14.556046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.559805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.561443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.567562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe960e0-cccf-4e3f-9b43-b697223bbe69 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.572667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 950/1898] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:14.573203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.573859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.574092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.574375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.575401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.576979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4aaefc-42c2-44a4-aa47-f4a46af4440f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.589497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 949/1899] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:14.594783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.606082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99066-16b8-4e6c-8c87-eaae59154e31 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.611067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.611732 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.612007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.612282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] PATH_INFO: `/v3/projects/66afb88456df433db089753b88d3911d/users/a95b9acab8524224ae6fd30205c27076/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.615516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:14.629370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66afb88456df433db089753b88d3911d, user_id=a95b9acab8524224ae6fd30205c27076, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.632033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.645690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 951/1900] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:14 2022] PUT /identity/v3/projects/66afb88456df433db089753b88d3911d/users/a95b9acab8524224ae6fd30205c27076/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:14.651697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83bde-7afc-459b-ad61-1d0b8becb339 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.651975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83bde-7afc-459b-ad61-1d0b8becb339 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.652262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f83bde-7afc-459b-ad61-1d0b8becb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.671849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e1f83bde-7afc-459b-ad61-1d0b8becb339 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:14.673075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e1f83bde-7afc-459b-ad61-1d0b8becb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.718694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:14.740624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 950/1901] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:14.751808 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:14.754443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:14.816526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd30bcd-dc58-460d-90f8-3f96698d3926 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:14.820721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:14.821530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:14.821802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:14.822065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:14.832290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:14.833753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:14.843313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 952/1902] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:15.912956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8393c-084b-4cac-bcbc-1d408108a4c9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:15.913540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8393c-084b-4cac-bcbc-1d408108a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:15.913661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8393c-084b-4cac-bcbc-1d408108a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:15.943789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aef8393c-084b-4cac-bcbc-1d408108a4c9 None None] MFA Rules not processed for user `a95b9acab8524224ae6fd30205c27076`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:15.945028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aef8393c-084b-4cac-bcbc-1d408108a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:16.047787 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 951/1903] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:16.058955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:16.065644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:16.161950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0193d-2743-4052-b911-e7eabb4b5bf3 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:16.166947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:16.168525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:16.172192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:16.172740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:16.187506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:16.189594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:16.213018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 953/1904] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:17.796869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcb2e-b3b3-46d8-8e1d-4a172b2f26f8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:17.797368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcb2e-b3b3-46d8-8e1d-4a172b2f26f8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:17.797471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcb2e-b3b3-46d8-8e1d-4a172b2f26f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:17.820305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a28dcb2e-b3b3-46d8-8e1d-4a172b2f26f8 None None] MFA Rules not processed for user `a95b9acab8524224ae6fd30205c27076`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:17.821869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a28dcb2e-b3b3-46d8-8e1d-4a172b2f26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:17.833071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 952/1905] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:18.069096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:18.071669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:18.091469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1fbae-8ce3-48eb-b3ef-da1efc1e2738 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:18.098192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:18.098881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:18.099734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:18.100053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] PATH_INFO: `/v3/users/80553be76789443fadf245ebd9fe2fb6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:18.101561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80553be76789443fadf245ebd9fe2fb6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:18.103645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:18.168535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80553be76789443fadf245ebd9fe2fb6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:18.169246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80553be76789443fadf245ebd9fe2fb6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:18.181894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80553be76789443fadf245ebd9fe2fb6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:18.204461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80553be76789443fadf245ebd9fe2fb6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:18.217500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80553be76789443fadf245ebd9fe2fb6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:18.231673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:18.232238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:18.232721 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:18.234168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 954/1906] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:18 2022] DELETE /identity/v3/users/80553be76789443fadf245ebd9fe2fb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:18.258770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:18.261080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:18.355246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 953/1907] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:18.366011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:18.369317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:18.381316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:18.488579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0c16-3101-4abd-bbc5-489b9df93e57 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:18.493580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:18.494220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:18.494498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:18.494799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:18.507973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:18.509500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:18.521109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 955/1908] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:18.959040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:18.960541 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:18.983874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce3186-f1b0-4e49-aada-4e63cffb657e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:18.992650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:18.993956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:18.995359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:18.996617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] PATH_INFO: `/v3/projects/19ccc8c9f76c4d58ba66ae57df29da46` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:18.998677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ccc8c9f76c4d58ba66ae57df29da46)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:19.005679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:19.128127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ccc8c9f76c4d58ba66ae57df29da46', 'request_id': 'req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.149522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ccc8c9f76c4d58ba66ae57df29da46', 'request_id': 'req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.156593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:19.159348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ccc8c9f76c4d58ba66ae57df29da46', 'request_id': 'req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.182475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] The token cache is being invalidate because project 19ccc8c9f76c4d58ba66ae57df29da46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:19.183091 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.183935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.186327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 954/1909] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:18 2022] DELETE /identity/v3/projects/19ccc8c9f76c4d58ba66ae57df29da46 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:19.190782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:19.223748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a33bb-e9e0-4f85-8801-f926917b9d37 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:19.354658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:19.355750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:19.357282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:19.357730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] PATH_INFO: `/v3/users/596b6b52d5974da1b40ce5fdb27427aa` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:19.359430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596b6b52d5974da1b40ce5fdb27427aa)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:19.362283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:19.464062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596b6b52d5974da1b40ce5fdb27427aa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.464921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596b6b52d5974da1b40ce5fdb27427aa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.477269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596b6b52d5974da1b40ce5fdb27427aa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.493907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596b6b52d5974da1b40ce5fdb27427aa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.503949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596b6b52d5974da1b40ce5fdb27427aa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:19.513025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 956/1910] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:19 2022] DELETE /identity/v3/users/596b6b52d5974da1b40ce5fdb27427aa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:20.040656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:20.046570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.083546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0e84-3d6e-4bb4-8a06-95febc1db5bc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:20.101965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:20.103442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.169779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:20.223842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:20.224645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.224982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.225531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] PATH_INFO: `/v3/users/9f033e9b611d4d7591b7ece1c6c2254c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.226760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f033e9b611d4d7591b7ece1c6c2254c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:20.229559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:20.246738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df45-bbb4-4447-8179-7cd74523dac1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:20.256389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:20.257086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.257529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.257962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] PATH_INFO: `/v3/projects/c0fdaa48ef46490f97a01bf18afc8afc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.261864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fdaa48ef46490f97a01bf18afc8afc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:20.263820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:20.326646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f033e9b611d4d7591b7ece1c6c2254c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.336461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f033e9b611d4d7591b7ece1c6c2254c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.355904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f033e9b611d4d7591b7ece1c6c2254c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.356117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f033e9b611d4d7591b7ece1c6c2254c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.375107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f033e9b611d4d7591b7ece1c6c2254c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.391546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fdaa48ef46490f97a01bf18afc8afc', 'request_id': 'req-55c30a25-c666-463f-bd17-b9248a4a68c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.402715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fdaa48ef46490f97a01bf18afc8afc', 'request_id': 'req-55c30a25-c666-463f-bd17-b9248a4a68c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.411035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fdaa48ef46490f97a01bf18afc8afc', 'request_id': 'req-55c30a25-c666-463f-bd17-b9248a4a68c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.412414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 955/1911] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:20 2022] DELETE /identity/v3/users/9f033e9b611d4d7591b7ece1c6c2254c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:20.416809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:20.419012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.429398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] The token cache is being invalidate because project c0fdaa48ef46490f97a01bf18afc8afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:20.430220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.431143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-55c30a25-c666-463f-bd17-b9248a4a68c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.434999 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 957/1912] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:20 2022] DELETE /identity/v3/projects/c0fdaa48ef46490f97a01bf18afc8afc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:20.436819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.437384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.438805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.465870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:20.467248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.540189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953016c4-34f1-45dd-a6ad-f7a1e99a8773 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:20.561790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:20.561790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.561790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.561790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] PATH_INFO: `/v3/users/9123c627653d4f43ac08cd56e6c2976e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.562287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9123c627653d4f43ac08cd56e6c2976e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:20.563204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:20.583386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:20.590086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 958/1913] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:20.590940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:20.594748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.629108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b997d-bae2-45be-a6e2-ea3315306384 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:20.642899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:20.643739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.644309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.644731 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] PATH_INFO: `/v3/users/b8f1ca62c31144b19afe6f96f9dbbc7e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.646798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f1ca62c31144b19afe6f96f9dbbc7e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:20.649272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:20.675905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9123c627653d4f43ac08cd56e6c2976e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.709030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9123c627653d4f43ac08cd56e6c2976e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.735240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9123c627653d4f43ac08cd56e6c2976e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.736253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9123c627653d4f43ac08cd56e6c2976e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.750798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f1ca62c31144b19afe6f96f9dbbc7e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.751879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f1ca62c31144b19afe6f96f9dbbc7e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.752550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9123c627653d4f43ac08cd56e6c2976e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.755337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:20.765118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f1ca62c31144b19afe6f96f9dbbc7e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.767666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 956/1914] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:20 2022] DELETE /identity/v3/users/9123c627653d4f43ac08cd56e6c2976e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:20.771665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:20.773519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.790730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f1ca62c31144b19afe6f96f9dbbc7e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.798584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-35f09133-7370-458c-a3af-f17293888e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f1ca62c31144b19afe6f96f9dbbc7e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:20.821478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 959/1915] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:20 2022] DELETE /identity/v3/users/b8f1ca62c31144b19afe6f96f9dbbc7e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:20.825943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:20.827442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:20.827730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:20.870412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:20.871701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:20.915120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1ec3c-e9ba-4277-8ef9-dfea74361c17 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:21.022522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 960/1916] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:21.042357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:21.044077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.047022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:21.050465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.050948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.051602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.058240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.060917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424f39-dec2-4fe5-9798-f968e24cba99 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:21.066422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:21.067367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.067764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.068152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.091540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:21.094096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dca28-0ea4-4ace-9397-ef5700f6911a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:21.102568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:21.105228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:21.113331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 961/1917] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:21.125109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 957/1918] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:21.220993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.221455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.221825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.276065 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] MFA Rules not processed for user `263600e8ce344a818a71400bb9c5dc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:21.278226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.422925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 962/1919] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:21.441732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:21.443587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.481827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:21.483500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.504123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb2e61-0a5a-4014-92c2-18797d5400bf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:21.512664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:21.513689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.514192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.514609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] PATH_INFO: `/v3/projects/ec631a67729d4f89841f7f724c787156` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.516233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec631a67729d4f89841f7f724c787156)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:21.519360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:21.586460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:21.659317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f720-f5a8-4fe8-a8a4-db6deaafd74d service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:21.671115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:21.672018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.672301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.672716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.690451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:21.696202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637687b0-e3e8-4431-8b77-f00a28f0d875 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:21.696651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:21.713983 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec631a67729d4f89841f7f724c787156', 'request_id': 'req-8ed6d902-4edb-4d66-896a-e7afa513f350'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:21.720285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 958/1920] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:21.734039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec631a67729d4f89841f7f724c787156', 'request_id': 'req-8ed6d902-4edb-4d66-896a-e7afa513f350'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:21.749389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec631a67729d4f89841f7f724c787156', 'request_id': 'req-8ed6d902-4edb-4d66-896a-e7afa513f350'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:21.786922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] The token cache is being invalidate because project ec631a67729d4f89841f7f724c787156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:21.787282 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:21.791935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8ed6d902-4edb-4d66-896a-e7afa513f350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:21.795450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 963/1921] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:21 2022] DELETE /identity/v3/projects/ec631a67729d4f89841f7f724c787156 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:21.801229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.801572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.802582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.834685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:21.835613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.914637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 959/1922] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:21.922674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.922940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.923213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.939773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:21.942979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.953436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:21.954568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:21.970986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9014-afc1-4ee5-8b9f-2b344d0752ea None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:21.978413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:21.979761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:21.980221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:21.980652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] PATH_INFO: `/v3/projects/2b918666422547c9bc4252473ae39330` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:21.983012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b918666422547c9bc4252473ae39330)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:21.988760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:21.992426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 964/1923] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:21.993807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.014970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33936c32-8d9e-4767-8953-8349f0c39da8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.025834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.026497 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.026810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.027117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.027800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:22.028695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.030345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.071779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 965/1924] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:22.076213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.090163 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc348-17dd-487f-902c-6e87f53d5073 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.107727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b918666422547c9bc4252473ae39330', 'request_id': 'req-dffe502c-3acd-4085-a724-d142228b623d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.121442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b918666422547c9bc4252473ae39330', 'request_id': 'req-dffe502c-3acd-4085-a724-d142228b623d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.137456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b918666422547c9bc4252473ae39330', 'request_id': 'req-dffe502c-3acd-4085-a724-d142228b623d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.159880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] The token cache is being invalidate because project 2b918666422547c9bc4252473ae39330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:22.160461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.161254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.163274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 960/1925] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:21 2022] DELETE /identity/v3/projects/2b918666422547c9bc4252473ae39330 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:22.164157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.165615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.212304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.213074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.213350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.213616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.214400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.217273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f920d8c-e11f-4405-819f-0d3d1d5a1ded admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.268458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 966/1926] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:22 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:22.270603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.271184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.271648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.273064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:22.281335 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe502c-3acd-4085-a724-d142228b623d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.300203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:22.303030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.385916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.388147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.389014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.391200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] PATH_INFO: `/v3/projects/d3c99982b8ce421aa58a0459bd25d024` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.394197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c99982b8ce421aa58a0459bd25d024)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.395835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.402433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 967/1927] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:22.403742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.405463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.451658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ff10c-391d-46e4-b582-0a0159d99250 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.457515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.458447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.458894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.459326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.460464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.467971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990d01-9176-41cd-9c96-1caf388ec957 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.512742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 968/1928] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:22 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:22.512742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.512742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.512742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.519269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c99982b8ce421aa58a0459bd25d024', 'request_id': 'req-8e4b5f47-d279-4076-99a7-75670d03cc9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.539002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c99982b8ce421aa58a0459bd25d024', 'request_id': 'req-8e4b5f47-d279-4076-99a7-75670d03cc9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.547483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:22.548156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c99982b8ce421aa58a0459bd25d024', 'request_id': 'req-8e4b5f47-d279-4076-99a7-75670d03cc9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.548730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.562811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:22.584559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] The token cache is being invalidate because project d3c99982b8ce421aa58a0459bd25d024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:22.585120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.586074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.591892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 961/1929] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:22 2022] DELETE /identity/v3/projects/d3c99982b8ce421aa58a0459bd25d024 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:22.593116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.597436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.659701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 969/1930] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:22.659701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.660545 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.675787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ba84-0517-4d65-8ea3-54de6bbe9b4c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.686096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.686751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.687192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.687474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] PATH_INFO: `/v3/users/461bfd8fa3f046eaa83f9679612d5003` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.688801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461bfd8fa3f046eaa83f9679612d5003)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.691451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.721104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5f47-d279-4076-99a7-75670d03cc9c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.738546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.740575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.740856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.741925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.749936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.752774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.781048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 962/1931] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:22.783058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.793670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461bfd8fa3f046eaa83f9679612d5003'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.794396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461bfd8fa3f046eaa83f9679612d5003'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.808309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc76a83-c637-4181-9799-227e89b35d9a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.812583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461bfd8fa3f046eaa83f9679612d5003'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.815371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:22.816170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:22.816577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:22.818678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:22.822301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:22.822301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:22.823276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:22.844192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461bfd8fa3f046eaa83f9679612d5003'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.858232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461bfd8fa3f046eaa83f9679612d5003'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:22.863311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 963/1932] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:22.863311 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.868637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.874846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 970/1933] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:22 2022] DELETE /identity/v3/users/461bfd8fa3f046eaa83f9679612d5003 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:22.875984 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:22.878793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:22.922593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e6929-24e2-49de-82ff-9eda4bdd90fe admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:22.992914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:23.013177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127a8-8503-4eef-b083-52c14b4e5c15 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.024179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.024990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.025368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.025702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.028409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.031338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.073977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.075835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.076451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.076858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.077297 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 971/1934] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:22 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:23.078091 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.080610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.081537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.107297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 964/1935] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:23.114962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.124816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:23.137031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcba94-f215-40d6-831f-c0c92bab7858 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.249145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b85f0-f53e-47bd-b0b2-24a445132b57 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.257559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.259839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.260158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.261072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] PATH_INFO: `/v3/projects/791dd5c04286470fbfe64b0ae3e1bcef/users/c44f0ffe638644ec8cf83c49fe7b98df/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.270880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.272159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.272442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.272750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.274289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.279215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1cae4-68bc-40e3-88cb-1b4b0e7a69fd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.304138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] RBAC: Authorizing `identity:create_grant(project_id=791dd5c04286470fbfe64b0ae3e1bcef, user_id=c44f0ffe638644ec8cf83c49fe7b98df, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.309285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.340640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 965/1936] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:23 2022] PUT /identity/v3/projects/791dd5c04286470fbfe64b0ae3e1bcef/users/c44f0ffe638644ec8cf83c49fe7b98df/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:23.340640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.342486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 972/1937] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:23 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:23.346455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.346776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.347084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.420542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] MFA Rules not processed for user `c44f0ffe638644ec8cf83c49fe7b98df`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:23.422460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:23.445621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f0b-d898-4886-85fc-c27181ab386a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.453824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.454578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.455087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.455446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.456213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.459130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.484617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 966/1938] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:23.486015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.516963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b9b3-42b9-4cbf-be71-9fbd5b01d7af admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.523142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.523760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.524035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.524414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.525108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.526710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.544281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 967/1939] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:23.545762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.569693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 973/1940] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:23.581941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2cf3-d700-4732-b7a6-18e3be087bcd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.584838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.586524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:23.594572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.595878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.596158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.598818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] PATH_INFO: `/v3/projects/5b6c552d61dd4c16ac7443fe0b82fb43/users/32aeb25a9b9b44fe8dbecd2fb5796c1c/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.636605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6c552d61dd4c16ac7443fe0b82fb43, user_id=32aeb25a9b9b44fe8dbecd2fb5796c1c, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.639886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b5ec8-5a5b-4747-892c-eed3f573151e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.651772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:23.663427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 968/1941] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:23 2022] PUT /identity/v3/projects/5b6c552d61dd4c16ac7443fe0b82fb43/users/32aeb25a9b9b44fe8dbecd2fb5796c1c/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:23.676206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.676564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.678270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58050c98-12f8-4bc1-b884-c2f091771812 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:23.678866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.751076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] MFA Rules not processed for user `32aeb25a9b9b44fe8dbecd2fb5796c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:23.752926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:23.759159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:23.773599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:23.775383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:23.776337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:23.776661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:23.882222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 969/1942] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:23.890002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:23.891570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f540e-a539-4b60-8dd8-3d2819ad42f7 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:23.901609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:23.903577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:23.936177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 974/1943] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:23.997208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979796-bdbf-483c-9f96-ce211ef8ab4f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:24.002324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:24.003754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:24.004039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:24.004414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:24.015035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:24.016634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:24.031797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 970/1944] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:24.186193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1806666-4599-48ef-a82a-742d3cf99ff1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:24.186682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1806666-4599-48ef-a82a-742d3cf99ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:24.187132 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1806666-4599-48ef-a82a-742d3cf99ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:24.217141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a1806666-4599-48ef-a82a-742d3cf99ff1 None None] MFA Rules not processed for user `263600e8ce344a818a71400bb9c5dc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:24.221150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a1806666-4599-48ef-a82a-742d3cf99ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:24.339089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 975/1945] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:24.674266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:24.676120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:24.844785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deba0e7-0a7a-44f3-b763-876b34722daf service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:24.852056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:24.852842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:24.853256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:24.853698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] PATH_INFO: `/v3/projects/671288562a43434f9cc588be63062806` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:24.855260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] RBAC: Authorizing `identity:delete_project(project_id=671288562a43434f9cc588be63062806)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:24.857577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:24.935863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:24.957583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671288562a43434f9cc588be63062806', 'request_id': 'req-5756223e-70e3-4703-8814-0fe46da9922a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:24.970843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671288562a43434f9cc588be63062806', 'request_id': 'req-5756223e-70e3-4703-8814-0fe46da9922a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:24.979907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671288562a43434f9cc588be63062806', 'request_id': 'req-5756223e-70e3-4703-8814-0fe46da9922a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:24.995954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] The token cache is being invalidate because project 671288562a43434f9cc588be63062806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:24.996453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:24.997703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5756223e-70e3-4703-8814-0fe46da9922a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:25.000317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 971/1946] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:24 2022] DELETE /identity/v3/projects/671288562a43434f9cc588be63062806 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:25.005406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.005834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.006014 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.050337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:25.053982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:25.161770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 976/1947] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:25.171360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.171665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.172077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.198144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:25.200880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:25.214981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 972/1948] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:25.216260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.226835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21ef6a-e270-4cc0-b8a8-f528ec587530 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.237473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.239330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.240075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.241761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.242837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:25.242837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.245865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.270566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 977/1949] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:25.272053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.282446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03acc0-94d7-4347-98c3-8797bf57db3e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.299037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.300763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.301147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.301864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.302675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.310194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.362621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 973/1950] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:25 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:25.367312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.381998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18840-ed87-4fdc-82e8-269a55a81e54 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.423670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:25.468112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.468826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.469229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.469526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.470294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.472430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.542760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 978/1951] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:25 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:25.547274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.583705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09360104-b738-432e-925f-3c5f818b9078 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.596339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.597061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.597342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.597614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.598273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.599908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.615270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 974/1952] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:25.619033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.652258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073283d-1fba-464f-aa5b-71e1f36f2266 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.666535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.668955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.669259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.669531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.671998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.679700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c0786-aa2f-4d96-ad45-9dda624c7363 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.705081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 979/1953] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:25.708083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:25.732917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6779b89-ae74-4e33-828f-924ba69ac1e2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:25.740199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:25.741049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.741723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.742118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] PATH_INFO: `/v3/projects/9fb0a7210b60478c902d91548fb5a28e/users/6b6ccb431802488f8e83a77e6b158832/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.808739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb0a7210b60478c902d91548fb5a28e, user_id=6b6ccb431802488f8e83a77e6b158832, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:25.811723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:25.844480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 975/1954] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:25 2022] PUT /identity/v3/projects/9fb0a7210b60478c902d91548fb5a28e/users/6b6ccb431802488f8e83a77e6b158832/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:25.858835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:25.859142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:25.859563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:25.926560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] MFA Rules not processed for user `6b6ccb431802488f8e83a77e6b158832`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:25.928209 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:26.035583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 980/1955] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:26.053462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:26.055497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:26.130756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f87a79-08a8-4b11-b667-85d642120d6c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:26.141544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:26.142276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:26.142552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:26.142845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:26.156609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:26.158220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77b83a-0b22-4d9a-8800-063fefa2c2cb service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:26.170191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 976/1956] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:26.204221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:26.281404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9002-54ad-4b1f-bc99-b8f15284a6b6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:26.290099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:26.291540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:26.291835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:26.292019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] PATH_INFO: `/v3/users/6b6ccb431802488f8e83a77e6b158832` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:26.293519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6ccb431802488f8e83a77e6b158832)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:26.295557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:26.357573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6ccb431802488f8e83a77e6b158832'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:26.358310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6ccb431802488f8e83a77e6b158832'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:26.361721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:26.374891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6ccb431802488f8e83a77e6b158832'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:26.395150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6ccb431802488f8e83a77e6b158832'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:26.402886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6ccb431802488f8e83a77e6b158832'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:26.411178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 981/1957] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:26 2022] DELETE /identity/v3/users/6b6ccb431802488f8e83a77e6b158832 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:26.415741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:26.416015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:26.416793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:26.437043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:26.441288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:26.510234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:26.520542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 977/1958] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:26.530144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:26.532029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:26.604354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb154f8-c6ea-407d-ad7f-444af5b03d1d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:26.610447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:26.611073 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:26.611349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:26.611615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:26.622771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:26.624258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e3c2-5dfa-4d83-923e-9e8223ed6713 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:26.635165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 982/1959] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:27.048773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.050696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:27.066564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae68c81-1bb4-4261-a0f7-b476c090fa5a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.072462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.072462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.072462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.072781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] PATH_INFO: `/v3/projects/9fb0a7210b60478c902d91548fb5a28e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.073804 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb0a7210b60478c902d91548fb5a28e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.076055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.129281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb0a7210b60478c902d91548fb5a28e', 'request_id': 'req-b42e6681-d515-4035-9b90-e3081d1fe098'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:27.145297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb0a7210b60478c902d91548fb5a28e', 'request_id': 'req-b42e6681-d515-4035-9b90-e3081d1fe098'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:27.154696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb0a7210b60478c902d91548fb5a28e', 'request_id': 'req-b42e6681-d515-4035-9b90-e3081d1fe098'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:27.172571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] The token cache is being invalidate because project 9fb0a7210b60478c902d91548fb5a28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:27.172843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:27.173579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b42e6681-d515-4035-9b90-e3081d1fe098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:27.175320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 978/1960] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:27 2022] DELETE /identity/v3/projects/9fb0a7210b60478c902d91548fb5a28e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:27.180464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.180948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.181213 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.202579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:27.203881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:27.270913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 983/1961] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:27.278580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.278872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.279158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.305898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:27.305898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:27.314413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 979/1962] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:27.318640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.329075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5cc3-0eea-486b-ba69-a793413e4e68 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.334861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.335563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.335838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.336146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.336870 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:27.337276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.339023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.355594 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 984/1963] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:27.359662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.369322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c45ead-79a0-4952-b6bf-e017342ab437 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.374080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.374719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.375005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.375274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.379256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.379256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.412800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 980/1964] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:27 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:27.413688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.424311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de979-f495-4224-ae04-94cc76d74a75 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.482232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:27.494461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.495092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.495371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.495639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.496286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.498464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.527321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 985/1965] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:27 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:27.532063 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.545799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e79968-1e49-4eb4-885d-5f2c1b3b85b2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.555529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.555529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.555529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.555529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.555900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.558524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.571814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 981/1966] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:27.576406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.587795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c688e06-5eae-4bda-bc5a-8229b2296edd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.592867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.593617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.593953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.594223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.595068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.596461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598d01-8cad-4eb7-aacc-6e862c202441 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.612357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.613111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 986/1967] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:27.624154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103a7ae-acc0-471e-80bf-a9e69dc104b3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.630039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.631067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.631185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.631438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] PATH_INFO: `/v3/projects/c8f6af70258e45b9aec9ded9dba53a45/users/a53026b445904f21ab86be2d85c930f2/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.650153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f6af70258e45b9aec9ded9dba53a45, user_id=a53026b445904f21ab86be2d85c930f2, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.652705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.667421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 982/1968] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:27 2022] PUT /identity/v3/projects/c8f6af70258e45b9aec9ded9dba53a45/users/a53026b445904f21ab86be2d85c930f2/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:27.682221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569732-aa4d-463c-a75e-382d09204161 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.683283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569732-aa4d-463c-a75e-382d09204161 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.683669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569732-aa4d-463c-a75e-382d09204161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.717372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-26569732-aa4d-463c-a75e-382d09204161 None None] MFA Rules not processed for user `a53026b445904f21ab86be2d85c930f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:27.718654 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26569732-aa4d-463c-a75e-382d09204161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:27.783825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 987/1969] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:27.795372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:27.797576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:27.880768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60dfc0-2fc8-4694-9e6d-9eb43612f4c1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:27.884807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:27.885468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:27.885747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:27.886017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:27.904867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:27.906599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586acbd8-9a9c-4dd1-9803-1df70c6b6815 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:27.918477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 983/1970] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:28.741907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569732-aa4d-463c-a75e-382d09204161 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:28.743370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26569732-aa4d-463c-a75e-382d09204161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:28.822651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26569732-aa4d-463c-a75e-382d09204161 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:28.832129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:28.832939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:28.833379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:28.833648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] PATH_INFO: `/v3/users/32aeb25a9b9b44fe8dbecd2fb5796c1c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:28.837356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aeb25a9b9b44fe8dbecd2fb5796c1c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:28.839334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:28.916101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aeb25a9b9b44fe8dbecd2fb5796c1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:28.916786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aeb25a9b9b44fe8dbecd2fb5796c1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:28.933482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aeb25a9b9b44fe8dbecd2fb5796c1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:28.941681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:28.947682 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aeb25a9b9b44fe8dbecd2fb5796c1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:28.956007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aeb25a9b9b44fe8dbecd2fb5796c1c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:28.963046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 988/1971] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:28 2022] DELETE /identity/v3/users/32aeb25a9b9b44fe8dbecd2fb5796c1c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:28.967300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c90f1-9ec8-41fd-8e05-8b581c09f417 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:28.967809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c90f1-9ec8-41fd-8e05-8b581c09f417 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:28.967900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c90f1-9ec8-41fd-8e05-8b581c09f417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:28.988218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a01c90f1-9ec8-41fd-8e05-8b581c09f417 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:28.989403 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a01c90f1-9ec8-41fd-8e05-8b581c09f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.007198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:29.050873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 984/1972] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:29.060681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:29.062260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.121034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e0a45-70dc-4df5-9886-a779bf78806d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:29.125062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:29.125722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.126105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.126376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.137638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:29.139162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:29.150615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 989/1973] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:29.304355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125aca5-d7ce-484b-9bb2-7038bd890dc7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.304694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125aca5-d7ce-484b-9bb2-7038bd890dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.304942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125aca5-d7ce-484b-9bb2-7038bd890dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.332079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f125aca5-d7ce-484b-9bb2-7038bd890dc7 None None] MFA Rules not processed for user `a53026b445904f21ab86be2d85c930f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:29.333321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f125aca5-d7ce-484b-9bb2-7038bd890dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.397619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 985/1974] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:29.448724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:29.450615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.471821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f4d29-781d-4a5f-b437-1a93aadde505 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:29.476532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:29.477288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.477595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.477862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] PATH_INFO: `/v3/projects/5b6c552d61dd4c16ac7443fe0b82fb43` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.479095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6c552d61dd4c16ac7443fe0b82fb43)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:29.481121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:29.532502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6c552d61dd4c16ac7443fe0b82fb43', 'request_id': 'req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:29.540936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6c552d61dd4c16ac7443fe0b82fb43', 'request_id': 'req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:29.548521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6c552d61dd4c16ac7443fe0b82fb43', 'request_id': 'req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:29.560612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] The token cache is being invalidate because project 5b6c552d61dd4c16ac7443fe0b82fb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:29.560902 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:29.561589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1e65963e-7ea6-4b91-b48a-cc2ecb952d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:29.563359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 990/1975] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:29 2022] DELETE /identity/v3/projects/5b6c552d61dd4c16ac7443fe0b82fb43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:29.568419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.568706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.568974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.591503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:29.592766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.658840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 986/1976] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:29.668308 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.668595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.668874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.696287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:29.697569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:29.706839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 991/1977] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:29.711025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:29.722282 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602914c5-ba39-44c6-9098-c832eac7d832 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:29.727138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:29.727872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.728239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.728877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.729431 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:29.729875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:29.731790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:29.744202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 987/1978] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:29.748549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:29.758807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3904-116f-4398-8c53-6b6ebbde0614 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:29.768000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:29.768945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.769353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.769713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.770486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:29.772566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:29.826324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 992/1979] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:29 2022] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:29.828266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:29.843522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dd73-f61c-4dbc-b874-40b602359b4c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:29.937177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:29.951770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:29.953616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:29.954061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:29.954763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:29.955658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:29.958586 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:30.009871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:30.026912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 988/1980] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:29 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:30.037347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4c65-ca49-4b7b-97b1-627fe6ded8bd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:30.050615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:30.051392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:30.056376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:30.056900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:30.058099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:30.061674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:30.075678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 993/1981] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:30.080073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:30.093581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfa769-34fc-4813-9e72-1e0e5a996848 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:30.121683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:30.121683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:30.121683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:30.121683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:30.122781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:30.122781 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70cbee-2bc7-453d-8912-ae7b1f89b49d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:30.164947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:30.177247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 989/1982] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:30.182821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a223-5878-4e61-ac82-76ada76744f7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:30.198400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:30.201764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:30.202269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:30.202814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] PATH_INFO: `/v3/projects/808790e327fd4104bb469bd45b42ae00/users/c863bbc138bd446790f350dfd1eb6d1f/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:30.264219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808790e327fd4104bb469bd45b42ae00, user_id=c863bbc138bd446790f350dfd1eb6d1f, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:30.267093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:30.300316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 994/1983] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:30 2022] PUT /identity/v3/projects/808790e327fd4104bb469bd45b42ae00/users/c863bbc138bd446790f350dfd1eb6d1f/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:30.309095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:30.309418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:30.309715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:30.350952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] MFA Rules not processed for user `c863bbc138bd446790f350dfd1eb6d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:30.352200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:30.498628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 990/1984] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:30.506785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:30.509133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:30.516043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:30.583750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2745e2-14a9-4a15-b009-25896fc041d1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:30.587464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:30.588076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:30.588344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:30.588603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:30.601043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:30.602366 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57d12-dad3-4bc8-924d-1de308fa4621 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:30.612026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 995/1985] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:34.938435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:34.940512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.021185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5be8a-d34a-40a2-82eb-c1ba8ff6c51b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.030565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.031304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.031623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.031895 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] PATH_INFO: `/v3/users/a6c11fba269b47fca384c7acb06238e5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.034234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c11fba269b47fca384c7acb06238e5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.037436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:35.095355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c11fba269b47fca384c7acb06238e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.103678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c11fba269b47fca384c7acb06238e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.113642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:35.118876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c11fba269b47fca384c7acb06238e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.120225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c11fba269b47fca384c7acb06238e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.134818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c11fba269b47fca384c7acb06238e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.141886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 991/1986] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:34 2022] DELETE /identity/v3/users/a6c11fba269b47fca384c7acb06238e5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:35.146582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.147122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.147122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.168458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:35.169713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.233809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 996/1987] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:35.244428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:35.246152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.311523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6e4e-2bb6-4011-a41c-90f109582223 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.315287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.315927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.316200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.316466 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.327934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.329438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd409e-9287-492f-aab8-e347410a9267 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:35.340789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 992/1988] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:43:35.622108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:35.623677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.640886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6cb8-50c1-426c-a51f-1873ae4ba90b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.648854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.650363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.651210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.651914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] PATH_INFO: `/v3/projects/5a1ea55a6aba467985df219eb9777d79` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.654441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1ea55a6aba467985df219eb9777d79)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.656755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:35.727756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1ea55a6aba467985df219eb9777d79', 'request_id': 'req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.743104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1ea55a6aba467985df219eb9777d79', 'request_id': 'req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.760383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1ea55a6aba467985df219eb9777d79', 'request_id': 'req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.776667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] The token cache is being invalidate because project 5a1ea55a6aba467985df219eb9777d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:35.776941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.777805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f73eb8a4-ed35-4caa-bbb7-38c2bfe4ee8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:35.780449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 997/1989] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:35 2022] DELETE /identity/v3/projects/5a1ea55a6aba467985df219eb9777d79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:35.785228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.785509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.785774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.812858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:35.814399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.883659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 993/1990] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:35.891792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.892151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.892529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.916501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:35.917779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.925805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 998/1991] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:35.930220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:35.941537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27457-47e9-4d49-9bf8-3d9efab72e61 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.946680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.947306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.947588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.948006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.948661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:35.948965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.951198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:35.965966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:35.967146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 994/1992] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:35.970462 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:35.971736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:35.987703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba1c2b-927a-4f47-a8cc-83f9b086d1c6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.988593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00d6cc-e085-46ae-a45a-a07ceb0cff7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:35.993170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.993872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.994083 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:35.994205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.994557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] PATH_INFO: `/v3/users/c863bbc138bd446790f350dfd1eb6d1f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.994707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:35.994992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:35.995267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:35.995862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c863bbc138bd446790f350dfd1eb6d1f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.995960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:35.997836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:35.997955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.024181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:36.047735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 995/1993] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:35 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:36.049565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.070964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c863bbc138bd446790f350dfd1eb6d1f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.071635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c863bbc138bd446790f350dfd1eb6d1f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.083197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c863bbc138bd446790f350dfd1eb6d1f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.108211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c863bbc138bd446790f350dfd1eb6d1f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.119887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-307e8fcf-53d1-4cff-a1ad-870f268fa1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c863bbc138bd446790f350dfd1eb6d1f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.130826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 999/1994] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:35 2022] DELETE /identity/v3/users/c863bbc138bd446790f350dfd1eb6d1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:36.135258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.136552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.137090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.152383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:36.177965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:36.179880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.181404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c43474-1341-402d-bf9d-5ed9c4f2051b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.262299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.262925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.263198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.263616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.264260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.266242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.266506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1000/1995] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:36.272917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.274913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.307583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 996/1996] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:36 2022] POST /identity/v3/users => generated 281 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:36.311856 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.313639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.327100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeff2ed-8341-4616-9775-7834339d9d21 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.334430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.335079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.335427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.335755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.336404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.338018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.348357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e834c29-8914-499e-add6-7f880fac93a6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.351945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 997/1997] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:36.352930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.357353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.357353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.357353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.357353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.363447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af43a2-10fa-4f0b-864e-ea9b1780c15d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.366393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.367963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.373243 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.374401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.374828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.375420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.376229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.378834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1001/1998] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:36.379953 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b382592-d7dd-454f-923c-bcc61de90aa8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.391899 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 998/1999] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:36.396089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.407875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b20-23d2-4200-b5e4-469afd2ece1c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.412640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.413434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.413771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.414102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] PATH_INFO: `/v3/projects/3dc8723f6bbf4976a0f9e96fb69ceca6/users/fe241621feca45eea57a3cbb763c25bd/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.435167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8723f6bbf4976a0f9e96fb69ceca6, user_id=fe241621feca45eea57a3cbb763c25bd, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.439655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.458471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1002/2000] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:36 2022] PUT /identity/v3/projects/3dc8723f6bbf4976a0f9e96fb69ceca6/users/fe241621feca45eea57a3cbb763c25bd/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:36.469755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.470121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.470623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.532126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] MFA Rules not processed for user `fe241621feca45eea57a3cbb763c25bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:36.533939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.663617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 999/2001] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:36.713186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.716422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.720887 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.723303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:36.751580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:36.836687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a069-2cc7-4102-97f3-cb3328d3cfed admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.842340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128def4-97cf-47db-84b3-9e393e358d21 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.845494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.848156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.848561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.848988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:36.849189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] PATH_INFO: `/v3/projects/808790e327fd4104bb469bd45b42ae00` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.849938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:36.850513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:36.851134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:36.851335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808790e327fd4104bb469bd45b42ae00)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.854482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.870663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:36.873299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:36.877270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:36.884825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1000/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:36.903746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:36.921950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4b8c-ba53-4b75-9fc2-cf843777175f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:36.924605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808790e327fd4104bb469bd45b42ae00', 'request_id': 'req-6548f581-4246-433e-98eb-dc6f8334aba7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.934362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808790e327fd4104bb469bd45b42ae00', 'request_id': 'req-6548f581-4246-433e-98eb-dc6f8334aba7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.942737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808790e327fd4104bb469bd45b42ae00', 'request_id': 'req-6548f581-4246-433e-98eb-dc6f8334aba7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.957973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] The token cache is being invalidate because project 808790e327fd4104bb469bd45b42ae00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:36.958795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.959645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6548f581-4246-433e-98eb-dc6f8334aba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:36.961317 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1003/2003] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:36 2022] DELETE /identity/v3/projects/808790e327fd4104bb469bd45b42ae00 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:37.017740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:37.017740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:37.017740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:37.017740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] PATH_INFO: `/v3/users/fe241621feca45eea57a3cbb763c25bd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:37.019094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe241621feca45eea57a3cbb763c25bd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:37.021337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:37.087129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe241621feca45eea57a3cbb763c25bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:37.104424 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe241621feca45eea57a3cbb763c25bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:37.121940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe241621feca45eea57a3cbb763c25bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:37.122774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe241621feca45eea57a3cbb763c25bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:37.130853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe241621feca45eea57a3cbb763c25bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:37.137743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1001/2004] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:36 2022] DELETE /identity/v3/users/fe241621feca45eea57a3cbb763c25bd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:37.142722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:37.142990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:37.143309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:37.172588 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:37.174170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:37.255405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1004/2005] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:37.265330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:37.266751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:37.332323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b921d-2747-45fb-8532-41c0a9b41022 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:37.336229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:37.336985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:37.337290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:37.337560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:37.353644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:37.355410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f51181-4f5c-4838-bfbe-82a11896e05a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:37.366421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1002/2006] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:38.401770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:38.403339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:38.419167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faed4c-1566-4b24-a4de-a40fa8dd1abb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:38.424979 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:38.425681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.425960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.426233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] PATH_INFO: `/v3/projects/3dc8723f6bbf4976a0f9e96fb69ceca6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.427568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc8723f6bbf4976a0f9e96fb69ceca6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:38.429748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:38.514949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.526482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc8723f6bbf4976a0f9e96fb69ceca6', 'request_id': 'req-7229e996-2e4f-4892-98b3-1a2d0d39f20e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:38.538432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc8723f6bbf4976a0f9e96fb69ceca6', 'request_id': 'req-7229e996-2e4f-4892-98b3-1a2d0d39f20e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:38.545976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc8723f6bbf4976a0f9e96fb69ceca6', 'request_id': 'req-7229e996-2e4f-4892-98b3-1a2d0d39f20e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:38.567396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] The token cache is being invalidate because project 3dc8723f6bbf4976a0f9e96fb69ceca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:38.567639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:38.568271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7229e996-2e4f-4892-98b3-1a2d0d39f20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:38.573086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1005/2007] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:38 2022] DELETE /identity/v3/projects/3dc8723f6bbf4976a0f9e96fb69ceca6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:38.575142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.575590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.575711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.599599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:38.601120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:38.622694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:38.686500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1003/2008] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:38.696130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.696422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.696707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.723102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:38.724399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:38.737591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1006/2009] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:38.739127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:38.751185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2958a8-dead-4ddc-a448-4a56e851c438 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:38.756594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:38.757265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.757537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.757803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.758450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:38.758748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:38.760509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:38.777324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1004/2010] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:38.781856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:38.792936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640b77-0f68-43ff-9fdf-5987ac2a9086 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:38.799582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:38.799945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.800160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.800596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.801358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:38.803899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:38.845711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1007/2011] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:38 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:38.846502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:38.857428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5996779-c269-46ac-9657-e03585638621 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:38.961907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:38.962643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:38.963022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:38.964023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:38.964774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:38.967571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.002399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1005/2012] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:38 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:39.007176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.027934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf579d-6ce6-4ce0-8503-2eec809236a1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.038425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.039277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.039651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.040013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.041368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.044157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.065263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1008/2013] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:39.067371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.082780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888433b-d9e4-4e21-919f-457c3dc5b463 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.089506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.090273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.090549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.091412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.091527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.093247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b450-a5ab-4c56-8b91-b29b48f3080a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.106078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1006/2014] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:39.109878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.131463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0eb9-380a-4d9b-8cc9-acb8ab060b9a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.136509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.137223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.137500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.137920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] PATH_INFO: `/v3/projects/111fa2fc34a24458bab79c1e83a10ff6/users/3625ba5fcefe48a687f13f782f5735df/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.163291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111fa2fc34a24458bab79c1e83a10ff6, user_id=3625ba5fcefe48a687f13f782f5735df, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.166085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.197335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1009/2015] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:39 2022] PUT /identity/v3/projects/111fa2fc34a24458bab79c1e83a10ff6/users/3625ba5fcefe48a687f13f782f5735df/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:39.211724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092439-dec9-4181-a808-fed76617f11a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.212220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092439-dec9-4181-a808-fed76617f11a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.213795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092439-dec9-4181-a808-fed76617f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.282212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f9092439-dec9-4181-a808-fed76617f11a None None] MFA Rules not processed for user `3625ba5fcefe48a687f13f782f5735df`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:39.283496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f9092439-dec9-4181-a808-fed76617f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:39.397762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.398165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1007/2016] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:39.466347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ea549-98e6-4e46-9821-15a6d257afb4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.471050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.471794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.472567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.472567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.473191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.475135 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.514068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1010/2017] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:43:39.515547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092439-dec9-4181-a808-fed76617f11a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.527108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092439-dec9-4181-a808-fed76617f11a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.542392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:39.607321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.608636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.608905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.609204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.609850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.611744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.632677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1008/2018] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:39.636632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.647396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795fd2a-9cae-47df-b51c-78908ddd90eb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.652011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.652620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.652888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.653192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.653824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.655424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.666522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1011/2019] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:43:39.671078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.681209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca7570-c1d7-473c-8071-4cacfe0aaf5a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.685823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.686422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.686698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.686963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.687610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.689254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d963ea4-7f47-41f9-b95c-2dc573de0092 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.700262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1009/2020] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:39.704009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.714407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4498f-c9b7-4e3f-a61a-553c5e721175 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.719144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.719801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.720081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.720370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] PATH_INFO: `/v3/projects/424b39c085aa4ae2a61f38c76bd61f0c/users/c9ca2be863ab4b259904dcf826bd1bdc/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.740204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424b39c085aa4ae2a61f38c76bd61f0c, user_id=c9ca2be863ab4b259904dcf826bd1bdc, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.742913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.757862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1012/2021] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:39 2022] PUT /identity/v3/projects/424b39c085aa4ae2a61f38c76bd61f0c/users/c9ca2be863ab4b259904dcf826bd1bdc/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:39.769025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.769309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.769579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.798064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] MFA Rules not processed for user `c9ca2be863ab4b259904dcf826bd1bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:39.799321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:39.866902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1010/2022] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:39.871402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.886103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:39.942947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf1271-6020-40a5-a048-93ea068a1617 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:39.947751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:39.948367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:39.948738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:39.949088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:39.950238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:39.952197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:39.982622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1013/2023] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:39.983875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:39.994889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd22f-bdc5-4d66-b211-32aa64abc30b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.052833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.053517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.054046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.054515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.055190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.058009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.086477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1011/2024] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:39 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:40.087972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:40.100737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebffa2-d1a0-452e-926d-bf7d315223a6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.106361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.106995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.107291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.107527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.108182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.109861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.121653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1014/2025] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:40.125912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:40.137866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee945f-654e-49f4-b09c-d42a08f4452b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.143228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.143897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.144169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.144474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] PATH_INFO: `/v3/projects/662ba58400384d1584e97a5517fab7b2/users/a3595cf93543409e80e308d80e564ef7/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.159568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:40.164053 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662ba58400384d1584e97a5517fab7b2, user_id=a3595cf93543409e80e308d80e564ef7, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.167068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.182585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1012/2026] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:40 2022] PUT /identity/v3/projects/662ba58400384d1584e97a5517fab7b2/users/a3595cf93543409e80e308d80e564ef7/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:40.186531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:40.196886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543f7f-f5d1-43cc-9804-a1593db01f32 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.274705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.275488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.275764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.276029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.276670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.278414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181f1db-ccef-4aca-a7b0-61c92e5a0ce5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.289635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1015/2027] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:40.293883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:40.305464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a4090-36c9-4bbb-9825-8990fce7a2f4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.310882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.311624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.311816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.312260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] PATH_INFO: `/v3/projects/662ba58400384d1584e97a5517fab7b2/users/a3595cf93543409e80e308d80e564ef7/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.314295 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662ba58400384d1584e97a5517fab7b2, user_id=a3595cf93543409e80e308d80e564ef7, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.317068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.336970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1013/2028] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:40 2022] PUT /identity/v3/projects/662ba58400384d1584e97a5517fab7b2/users/a3595cf93543409e80e308d80e564ef7/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:40.347223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.347504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.347964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.375902 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] MFA Rules not processed for user `a3595cf93543409e80e308d80e564ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:40.377195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:40.455901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1016/2029] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:43:40.467634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:40.469451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:40.530088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fd88-92c9-4692-bd46-2677fd553560 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:40.534155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:40.534768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:40.535041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:40.535306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:40.597619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:40.599112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:40.608344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1014/2030] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:42.320809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:42.325370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:42.355544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed8b92-d7d7-4306-99d3-b403ca51cf83 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:42.359345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:42.359961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:42.360235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:42.360495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:42.366607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:42.443498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:42.445320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:42.461149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1017/2031] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:43.130780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:43.139622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8177c0c-96a6-417a-8b90-e5d1eb42b82a service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:43.146438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:43.147072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:43.147347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:43.147614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:43.158348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:43.160068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c989-933a-4eda-8e89-0a6e6a0594f0 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:43.173429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1015/2032] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:48.195962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:48.260590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcfc3f-b9cc-4034-9a84-e9f715836f0d service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:48.265540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:48.266176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:48.266448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:48.266717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] PATH_INFO: `/v3/users/3625ba5fcefe48a687f13f782f5735df` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:48.267883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3625ba5fcefe48a687f13f782f5735df)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:48.269824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:48.322353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3625ba5fcefe48a687f13f782f5735df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.323050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3625ba5fcefe48a687f13f782f5735df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.331629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3625ba5fcefe48a687f13f782f5735df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.344469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3625ba5fcefe48a687f13f782f5735df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.351394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3625ba5fcefe48a687f13f782f5735df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.359116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1018/2033] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:48 2022] DELETE /identity/v3/users/3625ba5fcefe48a687f13f782f5735df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:48.362511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:48.363035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:48.363035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:48.383230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:48.384443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:48.448945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1016/2034] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:48.459367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:48.460972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:48.494661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:48.525653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0d2-ba65-4627-bc04-d73b7d731149 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:48.529807 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:48.530447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:48.530723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:48.531119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:48.542303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:48.543780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:48.554046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1019/2035] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:43:48.825114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:48.826629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:48.839497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dffa2c-d5ff-4dcd-a353-59874eefa87f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:48.845108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:48.845892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:48.846190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:48.846457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] PATH_INFO: `/v3/projects/111fa2fc34a24458bab79c1e83a10ff6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:48.849070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111fa2fc34a24458bab79c1e83a10ff6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:48.851496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:48.871768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:48.911933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111fa2fc34a24458bab79c1e83a10ff6', 'request_id': 'req-611e9573-5687-4d6c-984d-54619f9bf2c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.920620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111fa2fc34a24458bab79c1e83a10ff6', 'request_id': 'req-611e9573-5687-4d6c-984d-54619f9bf2c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.926655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111fa2fc34a24458bab79c1e83a10ff6', 'request_id': 'req-611e9573-5687-4d6c-984d-54619f9bf2c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.942575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] The token cache is being invalidate because project 111fa2fc34a24458bab79c1e83a10ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:48.942935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.943599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:48.945195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1017/2036] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:48 2022] DELETE /identity/v3/projects/111fa2fc34a24458bab79c1e83a10ff6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:48.949286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:48.959316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932af63-b900-4c8f-a3e8-3ddc00b38197 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:49.016348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:49.016985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:49.016985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:49.017496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] PATH_INFO: `/v3/users/c9ca2be863ab4b259904dcf826bd1bdc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:49.018821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ca2be863ab4b259904dcf826bd1bdc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:49.020667 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:49.071644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ca2be863ab4b259904dcf826bd1bdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.072310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ca2be863ab4b259904dcf826bd1bdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.082501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ca2be863ab4b259904dcf826bd1bdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.095650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ca2be863ab4b259904dcf826bd1bdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.103020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ca2be863ab4b259904dcf826bd1bdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.109875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1020/2037] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:48 2022] DELETE /identity/v3/users/c9ca2be863ab4b259904dcf826bd1bdc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:49.404409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:49.406131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:49.427046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e9573-5687-4d6c-984d-54619f9bf2c4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:49.492329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:49.492890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:49.493196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:49.493486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] PATH_INFO: `/v3/projects/424b39c085aa4ae2a61f38c76bd61f0c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:49.494670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=424b39c085aa4ae2a61f38c76bd61f0c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:49.496590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:49.550109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424b39c085aa4ae2a61f38c76bd61f0c', 'request_id': 'req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.571100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424b39c085aa4ae2a61f38c76bd61f0c', 'request_id': 'req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.582656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424b39c085aa4ae2a61f38c76bd61f0c', 'request_id': 'req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.598353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] The token cache is being invalidate because project 424b39c085aa4ae2a61f38c76bd61f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:49.598591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.599320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.601233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1018/2038] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:49 2022] DELETE /identity/v3/projects/424b39c085aa4ae2a61f38c76bd61f0c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:49.605038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:49.606502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:49.619250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f4379-6362-4f1e-a555-68f6f3e727e8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:49.667385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:49.683201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:49.684078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:49.684457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:49.684824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] PATH_INFO: `/v3/users/a3595cf93543409e80e308d80e564ef7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:49.686114 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3595cf93543409e80e308d80e564ef7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:49.688330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:49.749717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3595cf93543409e80e308d80e564ef7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.751883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3595cf93543409e80e308d80e564ef7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.763368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3595cf93543409e80e308d80e564ef7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.777351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3595cf93543409e80e308d80e564ef7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.787002 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-060d5cc6-0001-42e6-aa5c-82ccfc00747b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3595cf93543409e80e308d80e564ef7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:49.796630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1021/2039] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:43:49 2022] DELETE /identity/v3/users/a3595cf93543409e80e308d80e564ef7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:50.139069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.142015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:50.177500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dbc33-9a93-4155-9617-90bf9c6c5fcd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.208837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:50.244394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.245268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.245575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.246108 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] PATH_INFO: `/v3/projects/662ba58400384d1584e97a5517fab7b2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.246966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662ba58400384d1584e97a5517fab7b2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.249038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.309198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662ba58400384d1584e97a5517fab7b2', 'request_id': 'req-2c282f12-1c30-4d19-9664-3617715ec5f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:50.317318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662ba58400384d1584e97a5517fab7b2', 'request_id': 'req-2c282f12-1c30-4d19-9664-3617715ec5f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:50.323772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662ba58400384d1584e97a5517fab7b2', 'request_id': 'req-2c282f12-1c30-4d19-9664-3617715ec5f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:50.335333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] The token cache is being invalidate because project 662ba58400384d1584e97a5517fab7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:43:50.335614 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:50.336235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2c282f12-1c30-4d19-9664-3617715ec5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:43:50.337771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1019/2040] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:43:50 2022] DELETE /identity/v3/projects/662ba58400384d1584e97a5517fab7b2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:43:50.343305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.343678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.344034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.364565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:50.365832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:50.428421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1022/2041] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:50.436503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.436985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.437119 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.460043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:50.461317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:50.469719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1020/2042] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:50.474691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.488341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f21262-7229-4929-929a-33ca52d4bdc6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.493775 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.494396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.494674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.494985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.495633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:43:50.495937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.497620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.511821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1023/2043] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:43:50.516649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.526952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb5c4e-19b3-4de8-a009-baa816c8e361 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.533257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.533964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.534307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.534649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.535364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.537530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.576013 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1021/2044] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:43:50 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:50.577190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.587789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba295-1096-41ea-a110-e285d032f52a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.643621 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:50.652151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.653579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.654172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.655878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.656680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.658741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.687858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1024/2045] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:43:50 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:43:50.689475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.700670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f032c-7307-4b70-b6b9-4feaa62d1e33 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.705319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.705982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.706254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.706535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.707229 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.708915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.720314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1022/2046] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:50.726688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.736607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1c16-46ce-4aa6-ba3b-2599883387ff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.741260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.741855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.742122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.742394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.743023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.744616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26228c-308f-41c0-8383-b1d400d4c788 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.758146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1025/2047] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:43:50.762503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.773481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dc1ae-23b4-4dd9-a32f-4e57a476f0fb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:50.778664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:50.779359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.779640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.779911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] PATH_INFO: `/v3/projects/fa7625e4105142e08cc00034e38c75a1/users/e2026878fe034b4fb5437d91424babc9/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.794712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7625e4105142e08cc00034e38c75a1, user_id=e2026878fe034b4fb5437d91424babc9, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:50.797423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:50.812164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1023/2048] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:43:50 2022] PUT /identity/v3/projects/fa7625e4105142e08cc00034e38c75a1/users/e2026878fe034b4fb5437d91424babc9/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:43:50.823889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:50.824174 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:50.824804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:50.852909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] MFA Rules not processed for user `e2026878fe034b4fb5437d91424babc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:43:50.854153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:50.931488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1026/2049] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:43:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:43:50.943336 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:43:50.945215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:43:51.010367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9cc0c-3b46-4178-9a62-33d7371e1be3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:43:51.014155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:43:51.014999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:43:51.015351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:43:51.015674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:43:51.025245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:43:51.026741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238a6a8-b5a2-427d-b625-c44887c185a7 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:43:51.031347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:43:51.036965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1024/2050] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:43:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:00.928637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:01.013499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:01.015238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:01.086079 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc8ad0-e84a-465e-a3c0-973e9e16b3db None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:01.091739 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:01.092549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:01.092659 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:01.092892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] PATH_INFO: `/v3/users/c44f0ffe638644ec8cf83c49fe7b98df` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:01.094109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44f0ffe638644ec8cf83c49fe7b98df)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:01.096042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:01.158765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44f0ffe638644ec8cf83c49fe7b98df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.159610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44f0ffe638644ec8cf83c49fe7b98df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.168666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44f0ffe638644ec8cf83c49fe7b98df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.181514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44f0ffe638644ec8cf83c49fe7b98df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.193319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44f0ffe638644ec8cf83c49fe7b98df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.199888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1027/2051] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:44:01 2022] DELETE /identity/v3/users/c44f0ffe638644ec8cf83c49fe7b98df => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:01.204534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:01.205040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:01.205133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:01.224824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:01.226061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:01.303152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1025/2052] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:01.326814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:01.328805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:01.443099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8fc78-da09-4254-aa9f-1c538cdd4a80 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:01.459852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:01.460705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:01.461061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:01.461501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:01.474910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:01.477024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219b2e8-ffa7-4f65-aa03-9c099beaaa30 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:01.507766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1028/2053] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:44:01.818896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:01.820391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:01.834014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a45e-71b7-4883-aca5-a6924bac5ffa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:01.844155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:01.844816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:01.845183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:01.845378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] PATH_INFO: `/v3/projects/791dd5c04286470fbfe64b0ae3e1bcef` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:01.846617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=791dd5c04286470fbfe64b0ae3e1bcef)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:01.848591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:01.900482 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791dd5c04286470fbfe64b0ae3e1bcef', 'request_id': 'req-5a85a462-0959-4c3d-88a0-0add3404bbbc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.909872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791dd5c04286470fbfe64b0ae3e1bcef', 'request_id': 'req-5a85a462-0959-4c3d-88a0-0add3404bbbc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.915780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791dd5c04286470fbfe64b0ae3e1bcef', 'request_id': 'req-5a85a462-0959-4c3d-88a0-0add3404bbbc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.926876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] The token cache is being invalidate because project 791dd5c04286470fbfe64b0ae3e1bcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:44:01.927183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.927823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:01.929362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1026/2054] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:44:01 2022] DELETE /identity/v3/projects/791dd5c04286470fbfe64b0ae3e1bcef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:44:03.736595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1d2b6-a8f1-4cd1-958e-2b96443ad038 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:03.737215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1d2b6-a8f1-4cd1-958e-2b96443ad038 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:03.737215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1d2b6-a8f1-4cd1-958e-2b96443ad038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:03.759969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d7d1d2b6-a8f1-4cd1-958e-2b96443ad038 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:03.761370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7d1d2b6-a8f1-4cd1-958e-2b96443ad038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:03.782102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:03.829939 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1029/2055] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:44:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:03.882184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:03.884632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:03.963220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85a462-0959-4c3d-88a0-0add3404bbbc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:03.969232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:03.969846 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:03.970122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:03.970420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:03.979176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:03.980792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:03.989087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1027/2056] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:44:04.605394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e9b-a613-4ec9-9c3b-2c1fd375268e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:04.605779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e9b-a613-4ec9-9c3b-2c1fd375268e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:04.606120 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e9b-a613-4ec9-9c3b-2c1fd375268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:04.625965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1fd28e9b-a613-4ec9-9c3b-2c1fd375268e None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:04.627136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1fd28e9b-a613-4ec9-9c3b-2c1fd375268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:04.634623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1030/2057] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:04.647626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:04.658790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429f79-ea4d-47c1-bf7c-58f9618562e1 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:04.664269 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:04.664875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:04.665193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:04.665459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:04.673948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:04.675580 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:04.680121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:04.685592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1028/2058] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:44:04.926598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f52e8-7cb0-4440-830e-e7523554e5fa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:04.927078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f52e8-7cb0-4440-830e-e7523554e5fa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:04.927167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f52e8-7cb0-4440-830e-e7523554e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:04.953592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-184f52e8-7cb0-4440-830e-e7523554e5fa None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:04.954816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-184f52e8-7cb0-4440-830e-e7523554e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:04.963176 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1031/2059] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:04.975559 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:04.986669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770d3b9-11bc-4fe6-a48e-762f2887a219 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:04.992513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:04.993154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:04.993425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:04.993690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:05.001913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:05.003464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:05.011306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1029/2060] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:44:05.335593 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:05.335872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:05.336143 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:05.357893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:05.359096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:05.366865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1032/2061] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:44:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:05.379215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:05.389932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813340bf-11a6-4f95-ad0d-985ed597dfab service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:05.396662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:05.397620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:05.398069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:05.398532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:05.408033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:05.409635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e45a0-f8e7-4203-a0a7-71e47098b8cf service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:05.418228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1030/2062] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:44:07.580253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:07.581901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:07.648249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d928-390a-4911-a95a-dcb3868d6fc8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:07.653153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:07.653802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:07.654072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:07.654342 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] PATH_INFO: `/v3/users/a53026b445904f21ab86be2d85c930f2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:07.655534 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53026b445904f21ab86be2d85c930f2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:07.657555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:07.710560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53026b445904f21ab86be2d85c930f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:07.711298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53026b445904f21ab86be2d85c930f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:07.719156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53026b445904f21ab86be2d85c930f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:07.730869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53026b445904f21ab86be2d85c930f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:07.737484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53026b445904f21ab86be2d85c930f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:07.743500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1033/2063] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:44:07 2022] DELETE /identity/v3/users/a53026b445904f21ab86be2d85c930f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:07.748500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:07.748982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:07.749102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:07.768685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:07.769912 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:07.839173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1031/2064] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:07.849414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:07.850861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:07.882603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:07.919379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454cd4b-4992-4251-b573-d162f6d83ede admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:07.923086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:07.923911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:07.924240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:07.924571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:07.940768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:07.942235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5db7-26d9-470a-b901-e4691dc702a4 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:07.957371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1034/2065] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:08.135225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.136992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:08.155179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e0ce6-7fff-4cfc-a516-e564188bbdd9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.159978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.160597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.160869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.161248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] PATH_INFO: `/v3/projects/c8f6af70258e45b9aec9ded9dba53a45` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.162415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f6af70258e45b9aec9ded9dba53a45)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.164444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.231381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f6af70258e45b9aec9ded9dba53a45', 'request_id': 'req-5d54c728-1e40-4e4a-a958-6c67974e7b9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:08.241849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f6af70258e45b9aec9ded9dba53a45', 'request_id': 'req-5d54c728-1e40-4e4a-a958-6c67974e7b9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:08.250389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f6af70258e45b9aec9ded9dba53a45', 'request_id': 'req-5d54c728-1e40-4e4a-a958-6c67974e7b9c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:08.262187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] The token cache is being invalidate because project c8f6af70258e45b9aec9ded9dba53a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:44:08.262561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:08.263393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5d54c728-1e40-4e4a-a958-6c67974e7b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:08.265299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1032/2066] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:44:08 2022] DELETE /identity/v3/projects/c8f6af70258e45b9aec9ded9dba53a45 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:08.271252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.271645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.271946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.292669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:08.293940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:08.355313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1035/2067] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:08.364552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.364854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.365109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.386328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:08.387581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:08.396810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1033/2068] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:08.401256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.411625 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d6733-6cfd-4709-8ec7-4cc9abde7624 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.417465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.417995 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.418267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.418531 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.419180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:44:08.419478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.421150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.433285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1036/2069] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:44:08.437790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.447353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63fd32-22db-4b1d-b28e-066cf9482cd1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.453542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.453660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.453933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.454174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.454824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.456713 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.485936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1034/2070] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:44:08 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:44:08.490039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.501023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b64a8-839a-46ba-a180-b0019a49be94 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.567960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.568576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.568874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.569154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.569800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.571726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.596221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1037/2071] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:44:08 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:44:08.600417 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.611111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf23f-ebfa-4f04-8612-e625f8fa5c50 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.616638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.617356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.617632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.617900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.618555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.620160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.631062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1035/2072] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:08.635201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.645771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3938d-cfa4-4d17-8647-bf7c763294af admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.651049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.651648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.651924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.652193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.652886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.654559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b13ad8-4d39-43c0-b088-c0e0554e8d19 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.666380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1038/2073] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:08.670730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.681169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb969a2-0c3b-4728-8c9b-b7696636dc6d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.686954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.687607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.687877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.688230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] PATH_INFO: `/v3/projects/0695576a8ca14c21a5fe72c5608fe33c/users/59706f251dd74b62aff1d5d37bcca996/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.704304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0695576a8ca14c21a5fe72c5608fe33c, user_id=59706f251dd74b62aff1d5d37bcca996, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.706967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.709184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:08.723407 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1036/2074] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:44:08 2022] PUT /identity/v3/projects/0695576a8ca14c21a5fe72c5608fe33c/users/59706f251dd74b62aff1d5d37bcca996/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:44:08.728673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9ea-6132-43d1-acdc-dafbbe45c1b5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.729067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9ea-6132-43d1-acdc-dafbbe45c1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.729339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15f9ea-6132-43d1-acdc-dafbbe45c1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.750749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cb15f9ea-6132-43d1-acdc-dafbbe45c1b5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:08.751966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb15f9ea-6132-43d1-acdc-dafbbe45c1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:08.781708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:08.819158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1039/2075] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:08.832461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:08.834759 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:08.905484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a9bb6-fa0f-4399-ad64-bf0ce5a1f523 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:08.909165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:08.909775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:08.910048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:08.910314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:08.919206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:08.920623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:08.929979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1037/2076] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:44:10.403437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e99f8-0091-46eb-a76c-dc00a0bc2f31 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:10.403437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e99f8-0091-46eb-a76c-dc00a0bc2f31 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:10.403982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e99f8-0091-46eb-a76c-dc00a0bc2f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:10.431744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e68e99f8-0091-46eb-a76c-dc00a0bc2f31 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:10.433914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e68e99f8-0091-46eb-a76c-dc00a0bc2f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:10.450092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1040/2077] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:10.573928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:10.575800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:10.737938 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c234-5427-47bd-b735-31cc4cd52bb2 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:10.746420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:10.747213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:10.747661 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:10.748005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:10.759751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:10.761602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb07d-6e5e-424a-bfd5-2fc95a2d162e service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:10.776258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1038/2078] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:11.193193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:11.193666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:11.194010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:11.218586 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] MFA Rules not processed for user `bbbde485e34442979c96792da000155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:11.223013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:11.289536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1041/2079] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:13.627124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:13.627670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:13.627854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:13.658330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] MFA Rules not processed for user `59706f251dd74b62aff1d5d37bcca996`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:13.659534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:13.779552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1039/2080] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:13.786165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:13.808447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf428-3d1a-4db8-9acf-7e2a7e2d340d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:13.815941 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:13.817061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:13.817473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:13.817899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:13.818828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:13.821287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:13.863533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1042/2081] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:44:13 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:44:13.867844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:13.890275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dcea5-ca89-4f3d-8a24-d95d4cc04f3e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:13.900205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:13.984903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:13.985555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:13.985828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:13.986719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:13.986719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:13.988660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:14.015173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1040/2082] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:44:13 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:44:14.019280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:14.043509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceadde-b205-4285-945e-ab3988a18ab8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:14.050564 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:14.055394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:14.055684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:14.055957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:14.063438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:14.065200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:14.081611 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1043/2083] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:14.083502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:14.094589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46041229-9bc4-4826-ab54-f1e09f95b0c3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:14.100701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:14.101640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:14.101909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:14.102177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] PATH_INFO: `/v3/projects/a21072fd51cd40cdab2e62cda8018d71/users/e428239e97004d2fb81c2a8b07052625/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:14.134746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21072fd51cd40cdab2e62cda8018d71, user_id=e428239e97004d2fb81c2a8b07052625, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:14.137534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:14.159956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1041/2084] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:44:14 2022] PUT /identity/v3/projects/a21072fd51cd40cdab2e62cda8018d71/users/e428239e97004d2fb81c2a8b07052625/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:14.164075 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:14.174770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dbc7-b280-44fc-be22-45cf06da30a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:14.262789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:14.263428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:14.263704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:14.263972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:14.264623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:14.266301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e667-7279-46d9-9a06-d3272a9b1f78 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:14.278393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1044/2085] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:14.282598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:14.293562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e44dca-f4a6-4640-ad33-924e4e7f7123 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:14.298393 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:14.299072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:14.299351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:14.299615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] PATH_INFO: `/v3/projects/a21072fd51cd40cdab2e62cda8018d71/users/e428239e97004d2fb81c2a8b07052625/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:14.305387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21072fd51cd40cdab2e62cda8018d71, user_id=e428239e97004d2fb81c2a8b07052625, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:14.308833 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:14.322160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1042/2086] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:44:14 2022] PUT /identity/v3/projects/a21072fd51cd40cdab2e62cda8018d71/users/e428239e97004d2fb81c2a8b07052625/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:15.550997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013cf9f-23ef-4a9b-81e3-a34c8ce97e55 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:15.552000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013cf9f-23ef-4a9b-81e3-a34c8ce97e55 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:15.552521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013cf9f-23ef-4a9b-81e3-a34c8ce97e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:15.605289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4013cf9f-23ef-4a9b-81e3-a34c8ce97e55 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:15.606991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4013cf9f-23ef-4a9b-81e3-a34c8ce97e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:15.667138 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:15.784112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1045/2087] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:15.817648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:15.983373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab146-2bab-4f53-83f3-7ca74a16c308 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:15.990575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:15.991542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:15.991918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:15.992285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:16.003469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:16.006274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:16.034289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1043/2088] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:19.813612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1cce-59a2-454d-836c-58324e63c7dc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:19.814446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1cce-59a2-454d-836c-58324e63c7dc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:19.814917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b1cce-59a2-454d-836c-58324e63c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:19.849873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b01b1cce-59a2-454d-836c-58324e63c7dc None None] MFA Rules not processed for user `e428239e97004d2fb81c2a8b07052625`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:19.851385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b01b1cce-59a2-454d-836c-58324e63c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:19.941107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1046/2089] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:19.952329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:19.953753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:20.029389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:20.033433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3447ec-4230-425b-9add-f11c2507e5c5 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:20.037823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:20.038430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:20.038699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:20.038961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:20.107563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:20.109086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:20.118582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1044/2090] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:20.258274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf185-4071-4b1d-a9f0-1f9b1a64133f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:20.258547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf185-4071-4b1d-a9f0-1f9b1a64133f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:20.258817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf185-4071-4b1d-a9f0-1f9b1a64133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:20.279173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-60bdf185-4071-4b1d-a9f0-1f9b1a64133f None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:20.280382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-60bdf185-4071-4b1d-a9f0-1f9b1a64133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:20.340418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1047/2091] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:44:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:20.353406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:20.354937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:20.434587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227374-1c59-4799-b107-f9234564bb4b service glance] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:20.446624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:20.449924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:20.450434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:20.450913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:20.460627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:20.462376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:20.470908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1045/2092] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:44:21.176258 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edb91c-80d2-45e7-b1a9-39ce48b42f0b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:21.176810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edb91c-80d2-45e7-b1a9-39ce48b42f0b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:21.177097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edb91c-80d2-45e7-b1a9-39ce48b42f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:21.227980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-14edb91c-80d2-45e7-b1a9-39ce48b42f0b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:21.229355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-14edb91c-80d2-45e7-b1a9-39ce48b42f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:21.243077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1048/2093] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:21.270332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:21.283284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdc4a4-eb76-4ff6-93a6-0bef35083942 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:21.300717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:21.312387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:21.315477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:21.316052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:21.333033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:21.334997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:21.349225 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1046/2094] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:26.269302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:26.270374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:26.271472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:26.300415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:26.303248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:26.313636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1049/2095] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:26.338671 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:26.340949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:26.363964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e9933-d145-40cb-adcd-de0b3a283c4b service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:26.371153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:26.373370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:26.373862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:26.374326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:26.386540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:26.388400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eadc77-a194-40a8-a45d-dbff56b17449 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:26.410631 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1047/2096] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:26.767647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:26.769273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:26.807148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bda1e-8fae-48fe-b53d-489d71c50237 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:26.817892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:26.818582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:26.818857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:26.819124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] PATH_INFO: `/v3/users/e2026878fe034b4fb5437d91424babc9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:26.820391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2026878fe034b4fb5437d91424babc9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:26.822498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:26.919969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2026878fe034b4fb5437d91424babc9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:26.920687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2026878fe034b4fb5437d91424babc9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:26.925839 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:26.930570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2026878fe034b4fb5437d91424babc9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:26.950188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2026878fe034b4fb5437d91424babc9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:26.957853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2026878fe034b4fb5437d91424babc9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:26.968719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1050/2097] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:44:26 2022] DELETE /identity/v3/users/e2026878fe034b4fb5437d91424babc9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:26.973179 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:26.973458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:26.974223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:26.994619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:26.996838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:27.088633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1048/2098] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:27.098259 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:27.100125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:27.194917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8305f-67a3-4ffe-93a8-cf7face0a64c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:27.204919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:27.205656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.205932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.206204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.223230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:27.225964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d3d8c-d92f-49e8-98fb-681b0a3b88df service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:27.263004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1051/2099] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:27.601015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:27.602605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:27.632534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965a89a-90a1-4ac0-a127-3459f70856ed None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:27.640291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:27.641446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.641903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.642327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] PATH_INFO: `/v3/projects/fa7625e4105142e08cc00034e38c75a1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.644435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7625e4105142e08cc00034e38c75a1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:27.657290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:27.659463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:27.724172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7625e4105142e08cc00034e38c75a1', 'request_id': 'req-8755975d-7ed2-484f-bef4-b1587d1803c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:27.736570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7625e4105142e08cc00034e38c75a1', 'request_id': 'req-8755975d-7ed2-484f-bef4-b1587d1803c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:27.742815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7625e4105142e08cc00034e38c75a1', 'request_id': 'req-8755975d-7ed2-484f-bef4-b1587d1803c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:27.757726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] The token cache is being invalidate because project fa7625e4105142e08cc00034e38c75a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:44:27.758604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:27.759511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8755975d-7ed2-484f-bef4-b1587d1803c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:27.761246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1049/2100] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:44:27 2022] DELETE /identity/v3/projects/fa7625e4105142e08cc00034e38c75a1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:27.766389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.767277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.767552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.790388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:27.791690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:27.871597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1052/2101] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:27.874780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.874780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.874780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.897480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:27.898961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:27.907289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1050/2102] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:27.911353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:27.921541 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd8601-aa16-47eb-af20-0ba195c72633 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:27.926358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:27.926973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.927265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.927524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.928194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:44:27.928489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:27.930151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:27.943585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1053/2103] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:44:27.948326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:27.962260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffc92a-c76f-4838-99de-fc710a8b2d32 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:27.967558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:27.968171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:27.968438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:27.968700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:27.969369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:27.971544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.008506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1051/2104] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:44:27 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:44:28.009638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:28.020407 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a9c8-ca32-425d-b502-2b0b78a9130e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:28.083367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:28.095357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:28.096409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.097899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.099139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.100007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:28.103369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.131913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1054/2105] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:44:28 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:44:28.133943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:28.145705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf4e9-b00c-471b-ba75-df3e845322aa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:28.153211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:28.153837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.154107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.154370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.155015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:28.156654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.169165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1052/2106] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:28.175844 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:28.186279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b0dcb-766c-4b96-9391-818c8d7ff31c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:28.192949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:28.193628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.193888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.194151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.194795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:28.196405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb8496-8973-43f8-bacd-c261cb6dc453 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.212225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1055/2107] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:44:28.216187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:28.227379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da3803-461d-431f-993f-36ee9933e4ff admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:28.232581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:28.233284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.233284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.234075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] PATH_INFO: `/v3/projects/d2e4ed8c120f442b8b3ab0d7982dd973/users/b589850976774e5cb447624500ee3dfc/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.249312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e4ed8c120f442b8b3ab0d7982dd973, user_id=b589850976774e5cb447624500ee3dfc, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:28.251944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.269366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1053/2108] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:44:28 2022] PUT /identity/v3/projects/d2e4ed8c120f442b8b3ab0d7982dd973/users/b589850976774e5cb447624500ee3dfc/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:28.346283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54bc41-d6c2-4bcc-a2a3-1e164bd3d51f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.346665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54bc41-d6c2-4bcc-a2a3-1e164bd3d51f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.346792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54bc41-d6c2-4bcc-a2a3-1e164bd3d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.378857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f54bc41-d6c2-4bcc-a2a3-1e164bd3d51f None None] MFA Rules not processed for user `b589850976774e5cb447624500ee3dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:28.381291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f54bc41-d6c2-4bcc-a2a3-1e164bd3d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:28.460989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1056/2109] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:28.473026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:28.474981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:28.553267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c3fa8-2a32-4e99-bd1d-753ba8759b60 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:28.558581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:28.559333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:28.559607 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:28.559872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:28.571967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:28.573535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a3d9d-efe7-4bb7-a236-fc43f0a4916e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:28.584917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1054/2110] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:30.456866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:30.457478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:30.457478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:30.476461 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] MFA Rules not processed for user `59706f251dd74b62aff1d5d37bcca996`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:30.477693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:30.537200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1057/2111] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:31.567224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd05a0-1095-47b8-87d3-1f6f5c2e1b8a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:31.567683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd05a0-1095-47b8-87d3-1f6f5c2e1b8a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:31.567815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd05a0-1095-47b8-87d3-1f6f5c2e1b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:31.588251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-15cd05a0-1095-47b8-87d3-1f6f5c2e1b8a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:31.589484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-15cd05a0-1095-47b8-87d3-1f6f5c2e1b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:31.615978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:31.660338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1055/2112] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:31.702304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:31.703969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:31.782262 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e76b19-c422-4237-bb0e-fb953da42dd2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:31.788227 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:31.789490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:31.789977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:31.790238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:31.797034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:31.799345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:31.801123 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:31.813991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1058/2113] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:34.893647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf7d4-9879-48ea-9eeb-00e2e9fa5aae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:34.894175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf7d4-9879-48ea-9eeb-00e2e9fa5aae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:34.894296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bf7d4-9879-48ea-9eeb-00e2e9fa5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:34.914869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-655bf7d4-9879-48ea-9eeb-00e2e9fa5aae None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:34.916137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-655bf7d4-9879-48ea-9eeb-00e2e9fa5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:34.976537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1056/2114] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:44:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:34.989523 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:34.991022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:35.065346 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04062dcf-3c7f-46e6-8219-1a7a17ca622e service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:35.071451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:35.072205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:35.072607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:35.072943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:35.084465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:35.086412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:35.097247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1059/2115] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 06:44:35.793955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:35.794306 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:35.794533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:35.814821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:35.816509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:35.826343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1057/2116] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:35.848925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:35.862180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7df18-ac33-4fe7-84b6-76b83a48a388 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:35.868231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:35.868774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:35.869078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:35.869348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:35.878721 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:35.880311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a4c4-81a5-49cd-9322-189c62a254d0 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:35.890052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1060/2117] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:44:38.863918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:38.874330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d30c9-f66c-4e33-b209-7813aa78cef8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:38.879544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:38.880185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:38.880458 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:38.880720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] PATH_INFO: `/v3/users/b589850976774e5cb447624500ee3dfc` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:38.882058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b589850976774e5cb447624500ee3dfc)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:38.883994 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:38.936238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b589850976774e5cb447624500ee3dfc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:38.945033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b589850976774e5cb447624500ee3dfc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:38.957931 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b589850976774e5cb447624500ee3dfc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:38.958630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b589850976774e5cb447624500ee3dfc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:38.966141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b589850976774e5cb447624500ee3dfc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:38.972571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1058/2118] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:44:38 2022] DELETE /identity/v3/users/b589850976774e5cb447624500ee3dfc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:38.977068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:38.977714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:38.977823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:38.998851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:44:38.999521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:39.059964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1061/2119] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:44:39.069908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:39.071344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:39.123769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:39.140621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ab7f0-ec51-4e66-9522-f36dac8c0a79 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:39.146576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:39.147318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:39.147660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:39.148001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:39.158043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:39.159657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de7bc4-578b-4db0-8488-a1be27d75363 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:39.171241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1059/2120] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:44:39.532105 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:44:39.533936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:44:39.547510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15a588-32e2-4c9b-bf32-3df1ed321bf1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:44:39.579347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:44:39.580093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:44:39.580437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:44:39.580778 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] PATH_INFO: `/v3/projects/d2e4ed8c120f442b8b3ab0d7982dd973` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:44:39.582059 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e4ed8c120f442b8b3ab0d7982dd973)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:44:39.584709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:44:39.637043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e4ed8c120f442b8b3ab0d7982dd973', 'request_id': 'req-c248215a-55fa-4888-aa29-90d045b2d5f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:39.646653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e4ed8c120f442b8b3ab0d7982dd973', 'request_id': 'req-c248215a-55fa-4888-aa29-90d045b2d5f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:39.652754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e4ed8c120f442b8b3ab0d7982dd973', 'request_id': 'req-c248215a-55fa-4888-aa29-90d045b2d5f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:39.654675 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:39.665515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] The token cache is being invalidate because project d2e4ed8c120f442b8b3ab0d7982dd973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:44:39.665845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:39.666498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c248215a-55fa-4888-aa29-90d045b2d5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:44:39.668074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1062/2121] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:44:39 2022] DELETE /identity/v3/projects/d2e4ed8c120f442b8b3ab0d7982dd973 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:44:49.166238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=8 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:44:49.664824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:08.310188 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce184a6-d00a-4e2f-8893-c992563e8d34 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:08.310685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce184a6-d00a-4e2f-8893-c992563e8d34 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:08.310685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce184a6-d00a-4e2f-8893-c992563e8d34 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:08.312212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1060/2122] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 11 06:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:45:08.319067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:08.319608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:08.319608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:08.341080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] MFA Rules not processed for user `d2b49f6dc22e4831951be6d7192226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:08.342327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:08.421194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1063/2123] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 11 06:45:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:08.426249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce184a6-d00a-4e2f-8893-c992563e8d34 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:08.445184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce184a6-d00a-4e2f-8893-c992563e8d34 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:08.450603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:08.451292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:08.451650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:08.451992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:08.454231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:08.466669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:08.468246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5009-a48d-4e56-888a-916a9b4da3e2 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:08.478970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1061/2124] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:45:12.982325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:12.983897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:13.042093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887173d-fb2f-4bfd-b9cf-b44d1bb1326d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:13.046300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:13.046903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:13.047175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:13.047444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:13.049401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:13.115178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:13.116653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee6bb-ec9b-4a0b-a5c4-41f4850f25ae service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:13.126140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1064/2125] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:45:13.163426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:13.163975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:13.163975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:13.184434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] MFA Rules not processed for user `a95b9acab8524224ae6fd30205c27076`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:13.185678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:13.244762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1062/2126] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:45:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:14.748977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616a3b-60d9-4452-aa12-7bd91cae7b94 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:14.749543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616a3b-60d9-4452-aa12-7bd91cae7b94 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:14.749650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07616a3b-60d9-4452-aa12-7bd91cae7b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:14.771669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-07616a3b-60d9-4452-aa12-7bd91cae7b94 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:14.773202 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-07616a3b-60d9-4452-aa12-7bd91cae7b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:14.826524 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:14.845289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1065/2127] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:14.872050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:14.875728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:15.009452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08acc-39f7-4e16-b5c3-ec32bfd68abc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:15.015873 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:15.016509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:15.016795 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:15.017093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:15.026637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:15.028578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc05d13-6a72-4f58-9a4f-40f3e8a44ef0 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:15.045060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1063/2128] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:45:24.835899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:25.035864 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=63 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:32.892414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b893fc-1232-48af-975c-2c4546292eca None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:32.893067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b893fc-1232-48af-975c-2c4546292eca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:32.893067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b893fc-1232-48af-975c-2c4546292eca None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:32.895013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1066/2129] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:45:32.901628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8311b-239f-412d-a463-f472cf542f85 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:32.902187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8311b-239f-412d-a463-f472cf542f85 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:32.902512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8311b-239f-412d-a463-f472cf542f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:32.922570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-42f8311b-239f-412d-a463-f472cf542f85 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:32.923917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42f8311b-239f-412d-a463-f472cf542f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.007171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1064/2130] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:45:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:33.026146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b893fc-1232-48af-975c-2c4546292eca None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:33.028052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50b893fc-1232-48af-975c-2c4546292eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.102528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b893fc-1232-48af-975c-2c4546292eca None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:33.105992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:33.106614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.106933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.107162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.116876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:33.118268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a94bb5-881b-4ec6-9931-d97169544e2e service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:33.128695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1067/2131] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:45:33.202288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4886ab-1dc3-45f0-952d-c84cebf304e5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.202595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4886ab-1dc3-45f0-952d-c84cebf304e5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.202869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4886ab-1dc3-45f0-952d-c84cebf304e5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.204251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1065/2132] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:45:33.208786 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c70c-ffa0-4f74-baf2-17354582d988 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.209102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c70c-ffa0-4f74-baf2-17354582d988 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.209224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.209409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8c70c-ffa0-4f74-baf2-17354582d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.209554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.209699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.230192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3cf8c70c-ffa0-4f74-baf2-17354582d988 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:33.230401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:33.231399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3cf8c70c-ffa0-4f74-baf2-17354582d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.231562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.238699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1068/2133] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:45:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:33.250612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:33.259851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5d43a-569f-4ef0-82bf-273b03373abf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:33.263635 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:33.264251 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.264527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.264796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.272080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:33.273570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:33.281542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1069/2134] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:45:33.294515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1066/2135] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:33.333940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:33.335705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.354040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf092c-e49f-4ec4-9c3e-0970fbc4d088 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:33.359778 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:33.360384 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.360658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.360921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.366824 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98af1-603d-417d-9622-2219dc1c37d1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.367168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98af1-603d-417d-9622-2219dc1c37d1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.367357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb98af1-603d-417d-9622-2219dc1c37d1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.368779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1067/2136] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:45:33.370580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:33.372410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:33.373563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44153e-7950-4985-8d4c-9b8b58366d91 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.373822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44153e-7950-4985-8d4c-9b8b58366d91 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.374169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44153e-7950-4985-8d4c-9b8b58366d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.383713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1070/2137] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:45:33.395599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eb44153e-7950-4985-8d4c-9b8b58366d91 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:33.396933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb44153e-7950-4985-8d4c-9b8b58366d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:33.406361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1068/2138] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:45:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:45:33.416865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:33.427108 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db2ae-c3e9-40ec-89c6-b3c58148e572 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:33.431305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:33.431907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:33.432187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:33.432457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:33.443373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:33.444816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb394516-6f10-4d69-a670-4e599646cfbf service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:33.456238 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1071/2139] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:45:37.502525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15524-497c-4814-b2be-791aec172cde None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:37.502967 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15524-497c-4814-b2be-791aec172cde None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:37.503314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15524-497c-4814-b2be-791aec172cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:37.508232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:37.508701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:37.508701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:37.524869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-93f15524-497c-4814-b2be-791aec172cde None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:37.526032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-93f15524-497c-4814-b2be-791aec172cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:37.529938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:45:37.531086 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:37.535151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1069/2140] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:37.538344 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1072/2141] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:45:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:45:37.550377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f15524-497c-4814-b2be-791aec172cde None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:37.561937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f15524-497c-4814-b2be-791aec172cde None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:37.566010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:45:37.567464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:45:37.568339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:37.569110 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:37.569409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:37.569746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:37.579364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:37.580988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ee673-1b36-46fd-b695-ee7ca58f3a11 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:37.583309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299d7e-bcab-4342-aee1-8f787e112ba8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:45:37.588859 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:45:37.589381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1070/2142] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:45:37.589488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:45:37.589770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:45:37.590017 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:45:37.599708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:45:37.601440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:45:37.612278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1073/2143] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:45:47.586460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=70 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:45:47.607153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=56 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:00.206263 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c7cc-0d1e-4b24-87d0-71b0b9a589f1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:00.206908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c7cc-0d1e-4b24-87d0-71b0b9a589f1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:00.206908 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c7cc-0d1e-4b24-87d0-71b0b9a589f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:00.230675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2a51c7cc-0d1e-4b24-87d0-71b0b9a589f1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:46:00.231917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a51c7cc-0d1e-4b24-87d0-71b0b9a589f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:00.242569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1071/2144] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:46:00.265589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:00.287804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737e7c-6557-453a-86b9-5a1cac6de358 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:00.305923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:00.306580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:00.306981 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:00.307305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:00.317756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:00.321907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:00.333584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1074/2145] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:46:04.475483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cecb-43ba-4db8-ba98-5244874118e9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:04.476291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cecb-43ba-4db8-ba98-5244874118e9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:04.476291 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cecb-43ba-4db8-ba98-5244874118e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:04.508128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d911cecb-43ba-4db8-ba98-5244874118e9 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:46:04.509363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d911cecb-43ba-4db8-ba98-5244874118e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:04.518788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1072/2146] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:46:04.543133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:04.554713 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebee95-98e2-4d00-89dc-dad8a1468841 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:04.560884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:04.561527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:04.561809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:04.562072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:04.572047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:04.574020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:04.583909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1075/2147] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:46:05.899034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4d26-861a-4928-9f63-7d044fd41017 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:05.899557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4d26-861a-4928-9f63-7d044fd41017 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:05.899557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4d26-861a-4928-9f63-7d044fd41017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:05.920004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-059c4d26-861a-4928-9f63-7d044fd41017 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:46:05.921402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-059c4d26-861a-4928-9f63-7d044fd41017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:05.929732 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1073/2148] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:46:05.942576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:05.954764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7549007-7901-4b37-9c75-4de427f8d07a service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:05.961016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:05.961688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:05.961953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:05.962218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:05.970487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:05.972045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:05.980009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1076/2149] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 06:46:08.674832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:08.675340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:08.675551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:08.696942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:46:08.698531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:08.708274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1074/2150] 10.222.0.20 () {58 vars in 1016 bytes} [Tue Oct 11 06:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:46:08.732094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:08.744327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f832da8-45c4-444a-af95-44badbd4c431 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:08.750177 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:08.750780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:08.751052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:08.751318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:08.759908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:08.761562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:08.771263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1077/2151] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:46:18.690879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=12 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:18.767133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=24 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:43.611770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:43.613839 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:43.628756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3292c8-86d6-403d-b0ce-97d46fa4c10f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:43.633565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:43.634187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:43.634459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:43.634723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] PATH_INFO: `/v3/users/a95b9acab8524224ae6fd30205c27076` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:43.635847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95b9acab8524224ae6fd30205c27076)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:43.637820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:43.689740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95b9acab8524224ae6fd30205c27076'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:43.698262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95b9acab8524224ae6fd30205c27076'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:43.710100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95b9acab8524224ae6fd30205c27076'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:43.710755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95b9acab8524224ae6fd30205c27076'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:43.717689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cfa21f22-68d7-4d44-a32b-b6cbfe1d4e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95b9acab8524224ae6fd30205c27076'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:43.724199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1075/2152] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:46:43 2022] DELETE /identity/v3/users/a95b9acab8524224ae6fd30205c27076 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:46:43.895284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:43.906666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d85d09-0c9d-4ff1-9a7a-d7c6346cf693 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:43.972642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:43.973303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:43.973591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:43.973843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] PATH_INFO: `/v3/projects/66afb88456df433db089753b88d3911d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:43.974952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66afb88456df433db089753b88d3911d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:43.976894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:44.025467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66afb88456df433db089753b88d3911d', 'request_id': 'req-342818de-5d00-4cbc-ab24-e2e3732ede07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:44.034165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66afb88456df433db089753b88d3911d', 'request_id': 'req-342818de-5d00-4cbc-ab24-e2e3732ede07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:44.039809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66afb88456df433db089753b88d3911d', 'request_id': 'req-342818de-5d00-4cbc-ab24-e2e3732ede07'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:44.051615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] The token cache is being invalidate because project 66afb88456df433db089753b88d3911d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:46:44.051891 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:44.052678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:46:44.054233 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1078/2153] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:46:43 2022] DELETE /identity/v3/projects/66afb88456df433db089753b88d3911d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:46:53.064643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:53.065303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:53.065303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:53.086535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] MFA Rules not processed for user `bbbde485e34442979c96792da000155f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:46:53.087809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:53.144866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1076/2154] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:46:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:46:54.048083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:46:58.782325 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:46:58.784056 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:58.842244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342818de-5d00-4cbc-ab24-e2e3732ede07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:46:58.846583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:46:58.847188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:46:58.847456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:46:58.847718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:46:58.849501 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:46:58.920936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:46:58.922516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:46:58.933418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1079/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:46:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:03.137444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:08.928837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=54 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:14.741547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:14.742986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:14.759777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f74bbb-f571-4de1-95ee-a6fb8bc229a0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:14.766215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:14.766944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:14.767287 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:14.767635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:14.769633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:14.829779 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:14.831362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f41da-7953-4db2-bbb1-38c2e5286e31 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:14.841425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1077/2156] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:17.706696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:17.708479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:17.720812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93b6e-dc83-4e27-b51a-85c732318e13 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:17.725153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:17.725749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:17.726019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:17.726280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:17.728347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:17.742133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:17.743554 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:17.754568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1080/2157] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:23.179970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:23.180444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:23.180564 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:23.201124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] MFA Rules not processed for user `a9f13d57ca4a40f6811758eb5103c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:47:23.202457 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:23.210902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1078/2158] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:47:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:47:23.526266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:23.538383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525a136-65d1-45c7-be0a-7a6038605707 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:23.543061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:23.543656 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:23.543938 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:23.544204 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:23.546225 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:23.556021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:23.557535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:23.566232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1081/2159] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:24.144169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:24.145644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:24.222383 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fe4c-a2bd-40e3-9f37-e952f63e9af6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:24.228249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:24.228862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:24.229175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:24.229441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:24.231376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:24.243750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:24.245398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:24.256101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1079/2160] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:26.443568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:26.452942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1448c2-3217-4f58-86a6-ea6f9a962d32 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:26.456889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:26.458041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:26.458527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:26.459115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:26.461277 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:26.472429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:26.474318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:26.482878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1082/2161] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:34.251637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=63 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:36.479487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=18 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:37.108540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:37.110264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:37.126440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87410fcc-1777-4dde-a25f-543803f0b968 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:37.132464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:37.133284 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:37.133594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:37.133924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:37.135901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:37.159697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:37.161353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:37.173676 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1080/2162] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:47:47.168816 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:47:57.308836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:47:57.310880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:57.374304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a12a-6fab-4b85-877d-9dcc3187ccbd service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:47:57.378473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:47:57.379081 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:47:57.379365 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:47:57.379634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:47:57.381767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:47:57.393743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:47:57.395187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34f415-d3b7-400d-9a44-9a4ef4083038 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:47:57.404476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1083/2163] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:47:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:03.761040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:03.791340 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b21bc4-099d-4a95-ac47-b5278529f75b service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:03.800265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:03.800952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:03.801258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:03.801529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:03.805774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:03.829949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:03.831975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:03.870970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1081/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:07.400381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=26 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:13.849596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:13.887353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:13.887806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:13.887934 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:13.907492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:13.908677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:13.965660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1084/2165] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:48:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:14.015227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:14.016719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:14.088128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751f42-4f18-42db-af35-8128c0f317cb service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:14.094058 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:14.094704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:14.094952 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:14.095220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:14.103954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:14.105575 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:14.113667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1082/2166] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:48:18.183427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:18.185154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:18.201506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28a82-fd2e-4f26-a031-4987568eece6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:18.209246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:18.210044 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:18.210314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:18.210799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:18.212884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:18.225975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:18.227850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:18.239801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1085/2167] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:19.613744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:19.623392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103754f-80ab-4cab-9992-1022c5c2209c service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:19.627446 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:19.628048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:19.628314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:19.628577 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:19.630429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:19.695718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:19.697072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:19.707198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1083/2168] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:21.641040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:21.654416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb3a2f-1d19-42af-a4d3-c0c0c0eac961 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:21.672631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:21.673338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:21.673817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:21.674389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:21.681651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:21.704747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:21.710193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:21.733892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1086/2169] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:21.780771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:21.782861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:21.799640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bdcea-45ba-4558-a66b-053f4d33fb53 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:21.805910 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:21.806733 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:21.807212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:21.807691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] PATH_INFO: `/v3/users/59706f251dd74b62aff1d5d37bcca996` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:21.809554 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59706f251dd74b62aff1d5d37bcca996)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:21.811870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:21.867485 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59706f251dd74b62aff1d5d37bcca996'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:21.877031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59706f251dd74b62aff1d5d37bcca996'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:21.893836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59706f251dd74b62aff1d5d37bcca996'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:21.895118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59706f251dd74b62aff1d5d37bcca996'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:21.906818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:21.910914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59706f251dd74b62aff1d5d37bcca996'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:21.924665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1084/2170] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:21 2022] DELETE /identity/v3/users/59706f251dd74b62aff1d5d37bcca996 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:22.117719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:22.129356 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ed451-03f0-48ee-9e1b-3d8454c082f5 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:22.196474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:22.197154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:22.197429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:22.197670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] PATH_INFO: `/v3/projects/0695576a8ca14c21a5fe72c5608fe33c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:22.198816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0695576a8ca14c21a5fe72c5608fe33c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:22.200725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:22.248377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0695576a8ca14c21a5fe72c5608fe33c', 'request_id': 'req-9a1a18bf-baf3-48bf-a106-8cd5529c043e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.256370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0695576a8ca14c21a5fe72c5608fe33c', 'request_id': 'req-9a1a18bf-baf3-48bf-a106-8cd5529c043e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.262349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0695576a8ca14c21a5fe72c5608fe33c', 'request_id': 'req-9a1a18bf-baf3-48bf-a106-8cd5529c043e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.274415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] The token cache is being invalidate because project 0695576a8ca14c21a5fe72c5608fe33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:22.274653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.275329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.276824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1087/2171] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:22 2022] DELETE /identity/v3/projects/0695576a8ca14c21a5fe72c5608fe33c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:22.280971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:22.282480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:22.295832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31879-fca6-4376-95fe-cc4adb56dcc0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:22.361226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:22.361886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:22.362164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:22.362437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] PATH_INFO: `/v3/users/e428239e97004d2fb81c2a8b07052625` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:22.363613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e428239e97004d2fb81c2a8b07052625)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:22.365815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:22.432589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e428239e97004d2fb81c2a8b07052625'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.440323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e428239e97004d2fb81c2a8b07052625'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.458008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e428239e97004d2fb81c2a8b07052625'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.458975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e428239e97004d2fb81c2a8b07052625'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.467838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8c4038d6-ace8-4995-aad9-8eb657f62747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e428239e97004d2fb81c2a8b07052625'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.474233 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1085/2172] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:22 2022] DELETE /identity/v3/users/e428239e97004d2fb81c2a8b07052625 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:22.678710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:22.680332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:22.698922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a18bf-baf3-48bf-a106-8cd5529c043e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:22.704905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:22.778810 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:22.779701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:22.779978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:22.780253 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] PATH_INFO: `/v3/projects/a21072fd51cd40cdab2e62cda8018d71` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:22.781416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21072fd51cd40cdab2e62cda8018d71)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:22.783530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:22.847676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21072fd51cd40cdab2e62cda8018d71', 'request_id': 'req-32426475-326b-40fd-b90f-595a2fe9125a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.857951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21072fd51cd40cdab2e62cda8018d71', 'request_id': 'req-32426475-326b-40fd-b90f-595a2fe9125a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.864276 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21072fd51cd40cdab2e62cda8018d71', 'request_id': 'req-32426475-326b-40fd-b90f-595a2fe9125a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.876015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] The token cache is being invalidate because project a21072fd51cd40cdab2e62cda8018d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:22.876306 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.876949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-32426475-326b-40fd-b90f-595a2fe9125a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:22.878493 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1088/2173] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:22 2022] DELETE /identity/v3/projects/a21072fd51cd40cdab2e62cda8018d71 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:22.883563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:22.884073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:22.884189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:22.904797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:22.906036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:22.967055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1086/2174] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:22.975742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:22.976054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:22.976318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:22.996190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:22.997429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.007623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1089/2175] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:23.012259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.022686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c54d-2c2c-4180-9706-f4deb0ac73d8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.028608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.029312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.029590 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.029859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.030522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:48:23.030822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.032456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.044801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1087/2176] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:48:23.049517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.059830 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81705953-40f0-4d07-8ce1-345bc1a390a6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.064765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.065412 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.065827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.066103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.066744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.068805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.099472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1090/2177] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:23.103965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.109515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:23.116094 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e8bb-06f6-494e-ac95-a57470adade9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.221127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.223394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.223688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.224056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.224674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.234937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.235414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.237290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.257427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdafd6-6029-4dce-aae2-36b798b250ac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.262823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.263464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.263735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.264237 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1088/2178] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:23.265156 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] PATH_INFO: `/v3/users/bbbde485e34442979c96792da000155f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.267087 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbde485e34442979c96792da000155f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.268390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.271211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.279171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119584-db03-4486-891f-f4d619c76691 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.284628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.285517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.285796 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.286050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.286996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.288634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.302365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1089/2179] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:23.306704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.321924 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc66e-549c-48b1-b78a-30a892e86129 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.327079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.327943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.328226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.328502 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.329187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.330875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.335196 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbde485e34442979c96792da000155f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.335949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbde485e34442979c96792da000155f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.343512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1090/2180] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:48:23.343648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbde485e34442979c96792da000155f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.347633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.352263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:23.357716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3ba78-d924-4337-b846-32fd2d405e55 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.357877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbde485e34442979c96792da000155f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.362643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.363300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.363635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.363823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] PATH_INFO: `/v3/projects/080df92f9cec459c98cd7d337ce0eac4/users/55df78a792e7485180f39ff2f10cf06c/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.366816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34f3efa1-0f4d-41a2-8987-b2c8f60f7821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbde485e34442979c96792da000155f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.372660 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1091/2181] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:23 2022] DELETE /identity/v3/users/bbbde485e34442979c96792da000155f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:23.378984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080df92f9cec459c98cd7d337ce0eac4, user_id=55df78a792e7485180f39ff2f10cf06c, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.381678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.395101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1091/2182] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:23 2022] PUT /identity/v3/projects/080df92f9cec459c98cd7d337ce0eac4/users/55df78a792e7485180f39ff2f10cf06c/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:23.400394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.400744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.403606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.420674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:23.421904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.483360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1092/2183] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:23.494539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.496385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.555908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.562358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0493-bfa5-43f7-89e9-7174edc4c394 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.562526 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.571222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.571858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.572196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.572384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.573646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add3ae4-3cbc-4b78-a50f-15fb78f6c44b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.579662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.580371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.580709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.580988 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] PATH_INFO: `/v3/projects/f2577363d54f4ac6a4cb0309a4974415` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.582191 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2577363d54f4ac6a4cb0309a4974415)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.583215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.584205 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.585077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc28495-3eee-44bd-bd96-f75f74d32e6c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.596858 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1092/2184] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:23.636192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2577363d54f4ac6a4cb0309a4974415', 'request_id': 'req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.645266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2577363d54f4ac6a4cb0309a4974415', 'request_id': 'req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.651747 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2577363d54f4ac6a4cb0309a4974415', 'request_id': 'req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.663640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] The token cache is being invalidate because project f2577363d54f4ac6a4cb0309a4974415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:23.663926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.664616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-dd86d679-5ce1-4330-a6e5-bdc2a3ebc671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:23.666363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1093/2185] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:23 2022] DELETE /identity/v3/projects/f2577363d54f4ac6a4cb0309a4974415 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:23.671464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.671774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.672062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.694364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:23.696536 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.746315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:23.768629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1093/2186] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:23.776966 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.777485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.777602 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.800148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:23.801960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:23.812909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1094/2187] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:23.817762 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.833208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b6bb-34bb-4959-8c43-2d68386ef474 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.838815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.839514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.839793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.840056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.840737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:48:23.841075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.842727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.855653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1094/2188] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:48:23.860021 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.869496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359d02-be27-4bfd-b28c-3f3d83bb11b4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.874606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.875292 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.875657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.875990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.876707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.878736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:23.908615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1095/2189] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:23.913016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:23.925222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73117-4980-49cc-b008-4ca9d50e9193 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:23.985570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:23.986192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:23.986472 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:23.986743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:23.987385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:23.989648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.013730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1095/2190] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:23 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:24.017899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.028642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d149b8-7d98-4d7f-a2f0-bb25a5fad706 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.033555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.034172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.034451 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.034712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.035368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.037475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.048084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1096/2191] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:24.052689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.063246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65708-cc82-49d8-903a-9ceffc4cfd77 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.067970 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.068573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.068848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.069261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.070297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.071923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1a0bd-108a-4d8d-8845-29e2e6e69257 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.082957 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1096/2192] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:24.087296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.097710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678c8e3-39de-42b9-8aaf-148edcde1e60 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.102579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.103236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.103519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.103789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] PATH_INFO: `/v3/projects/6ad0c10291f9487b9a25bfc4843b5e62/users/a139d5eeb2b943d793063eeaed320062/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.118882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad0c10291f9487b9a25bfc4843b5e62, user_id=a139d5eeb2b943d793063eeaed320062, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.121579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.136832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1097/2193] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:24 2022] PUT /identity/v3/projects/6ad0c10291f9487b9a25bfc4843b5e62/users/a139d5eeb2b943d793063eeaed320062/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:24.148547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.148820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.149122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.178077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] MFA Rules not processed for user `a139d5eeb2b943d793063eeaed320062`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:24.179524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:24.252421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1097/2194] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:24.257719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.263844 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:24.341219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b8459-9f1b-4ac9-912d-432204280b03 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.347387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.348440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.349038 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.349295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.349994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.352522 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.384473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1098/2195] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:24 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:24.389783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.401366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b76d5-9897-4e05-8be5-2c9cb91879ad None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.448162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:24.467134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.467788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.468061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.468326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.469026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.471059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.496562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1098/2196] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:24 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:24.500827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.511499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d9bbc-68b4-4c23-93bf-77af0e0a4dc0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.520145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.520867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.521192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.521465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.522173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.523871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.536459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1099/2197] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:48:24.541441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.553283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca74e38-b4c8-4deb-b22f-75bb200dfb2c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.562256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.562256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.562256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.562256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] PATH_INFO: `/v3/projects/a9bebb56c6f94569a5bb357805700b20/users/42dc1ccde7fe4906aa706b3f21c16d56/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.590680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bebb56c6f94569a5bb357805700b20, user_id=42dc1ccde7fe4906aa706b3f21c16d56, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.596048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.613143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1099/2198] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:24 2022] PUT /identity/v3/projects/a9bebb56c6f94569a5bb357805700b20/users/42dc1ccde7fe4906aa706b3f21c16d56/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:24.618160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.632663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e9283-9835-416b-8035-7b5db03a2166 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.698413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.699206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.699574 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.700097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.700861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.702670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b174d-ade0-4ba4-8fa8-804a2e824b73 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.714367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1100/2199] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:48:24.718666 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.729770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150022-a9b1-423e-aff2-b0bcc65a050f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.737208 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.738003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.738380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.738746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] PATH_INFO: `/v3/projects/a9bebb56c6f94569a5bb357805700b20/users/42dc1ccde7fe4906aa706b3f21c16d56/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.741587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bebb56c6f94569a5bb357805700b20, user_id=42dc1ccde7fe4906aa706b3f21c16d56, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:24.744251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:24.771922 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1100/2200] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:24 2022] PUT /identity/v3/projects/a9bebb56c6f94569a5bb357805700b20/users/42dc1ccde7fe4906aa706b3f21c16d56/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:24.774144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e9713-20d7-4d82-83c8-c1668e6078e5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.774429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e9713-20d7-4d82-83c8-c1668e6078e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.774697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e9713-20d7-4d82-83c8-c1668e6078e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:24.807597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-009e9713-20d7-4d82-83c8-c1668e6078e5 None None] MFA Rules not processed for user `42dc1ccde7fe4906aa706b3f21c16d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:24.808936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-009e9713-20d7-4d82-83c8-c1668e6078e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:24.885723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:24.892600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1101/2201] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:24.904555 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:24.906557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:24.980151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ebb1-7534-47e8-80df-9029c1ab9805 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:24.984668 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:24.985270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:24.985629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:24.985983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:25.053481 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:25.055626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:25.066133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1101/2202] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:27.717311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:27.717805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:27.717927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:27.746399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] MFA Rules not processed for user `55df78a792e7485180f39ff2f10cf06c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:27.749518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:27.787725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:27.797126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f02cf6-8cc4-4d22-8644-75af8afd8563 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:27.801385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:27.802164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:27.802369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:27.802641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:27.813774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:27.815334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:27.827010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1102/2203] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:27.831822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1102/2204] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:27.836465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:27.837902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:27.882362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:27.912137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8df5-5c75-4158-8365-c7f8e6609964 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:27.916596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:27.917231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:27.917501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:27.917775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:27.918421 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:27.920436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:27.951476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1103/2205] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:27 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:48:27.955605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:27.967579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c69d8-a8a3-4b1c-90ec-be90031fc36f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:28.058141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:28.058768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:28.059037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:28.059301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:28.059953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:28.061936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:28.093340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1103/2206] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:27 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:48:28.095423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:28.106184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68e5e1-5f0a-4dcf-9793-60bbffb14b42 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:28.115724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:28.116344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:28.116643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:28.116937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:28.118221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:28.120420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:28.133080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1104/2207] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:48:28.138458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:28.149291 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973a7ca-f222-4fbb-846d-079df4648bc4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:28.154437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:28.155229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:28.155508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:28.155777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] PATH_INFO: `/v3/projects/724b3b947fdc4ace8c389aeb25c61847/users/02be4f770823430ba8b6b560e92b11c3/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:28.174990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] RBAC: Authorizing `identity:create_grant(project_id=724b3b947fdc4ace8c389aeb25c61847, user_id=02be4f770823430ba8b6b560e92b11c3, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:28.177948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:28.200394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1104/2208] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:28 2022] PUT /identity/v3/projects/724b3b947fdc4ace8c389aeb25c61847/users/02be4f770823430ba8b6b560e92b11c3/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:28.204526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:28.215147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff0f93-c742-4478-8f5c-a48d46e0680f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:28.286558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:28.287257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:28.287623 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:28.288005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:28.288750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:28.290605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebb15d-c3c8-481b-8b8c-2751c0c2e337 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:28.300960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1105/2209] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:28.305422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:28.316083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa55941-afce-49b8-ba8b-62de68d7472a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:28.321232 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:28.321896 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:28.322166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:28.322432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] PATH_INFO: `/v3/projects/724b3b947fdc4ace8c389aeb25c61847/users/02be4f770823430ba8b6b560e92b11c3/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:28.324434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724b3b947fdc4ace8c389aeb25c61847, user_id=02be4f770823430ba8b6b560e92b11c3, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:28.327101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:28.338422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1105/2210] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:28 2022] PUT /identity/v3/projects/724b3b947fdc4ace8c389aeb25c61847/users/02be4f770823430ba8b6b560e92b11c3/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:32.692652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9bc3-c833-4fbe-9401-04b685182f54 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:32.693183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9bc3-c833-4fbe-9401-04b685182f54 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:32.693266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce9bc3-c833-4fbe-9401-04b685182f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:32.722456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-98ce9bc3-c833-4fbe-9401-04b685182f54 None None] MFA Rules not processed for user `02be4f770823430ba8b6b560e92b11c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:32.724341 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-98ce9bc3-c833-4fbe-9401-04b685182f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:32.795801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1106/2211] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:32.811404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:32.813423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:32.860207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:32.892414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2643b-a24d-4cbf-a7a5-6c3ee6584b37 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:32.898190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:32.898804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:32.899331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:32.899331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:32.961067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:32.961067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:32.970858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1106/2212] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:34.148599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4e3d-114b-4c05-b5fb-394422cef85e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:34.149117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4e3d-114b-4c05-b5fb-394422cef85e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:34.149117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae4e3d-114b-4c05-b5fb-394422cef85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:34.169033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a5ae4e3d-114b-4c05-b5fb-394422cef85e None None] MFA Rules not processed for user `55df78a792e7485180f39ff2f10cf06c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:34.170322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a5ae4e3d-114b-4c05-b5fb-394422cef85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:34.178085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1107/2213] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:41.020083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:41.088112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc934ad-377d-47d9-b34c-54c9a9c89c0e service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:41.093500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:41.094352 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:41.094652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:41.094921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] PATH_INFO: `/v3/users/a139d5eeb2b943d793063eeaed320062` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:41.096192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a139d5eeb2b943d793063eeaed320062)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:41.098181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:41.149926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a139d5eeb2b943d793063eeaed320062'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.150584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a139d5eeb2b943d793063eeaed320062'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.159106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a139d5eeb2b943d793063eeaed320062'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.171949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a139d5eeb2b943d793063eeaed320062'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.178041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:41.181188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a139d5eeb2b943d793063eeaed320062'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.189831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1107/2214] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:41 2022] DELETE /identity/v3/users/a139d5eeb2b943d793063eeaed320062 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:41.194380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:41.195244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:41.195337 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:41.215543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:41.216757 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:41.238166 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:41.278836 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1108/2215] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:41.288610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:41.290085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:41.353837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b6acf-4e78-455b-a7cb-d78cc1b98e13 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:41.357863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:41.358482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:41.358756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:41.359024 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:41.369319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:41.370929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:41.382182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1108/2216] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:41.660047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:41.661611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:41.675691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cffb4-9d42-45d2-baf7-1fa4ff7a7c14 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:41.681060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:41.681722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:41.681982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:41.682388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] PATH_INFO: `/v3/projects/6ad0c10291f9487b9a25bfc4843b5e62` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:41.683602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad0c10291f9487b9a25bfc4843b5e62)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:41.685553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:41.738000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad0c10291f9487b9a25bfc4843b5e62', 'request_id': 'req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.749544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad0c10291f9487b9a25bfc4843b5e62', 'request_id': 'req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.755304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad0c10291f9487b9a25bfc4843b5e62', 'request_id': 'req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.767490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] The token cache is being invalidate because project 6ad0c10291f9487b9a25bfc4843b5e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:41.767776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.768519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.770192 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1109/2217] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:41 2022] DELETE /identity/v3/projects/6ad0c10291f9487b9a25bfc4843b5e62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:41.774511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:41.785224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a612-a562-45e9-8550-1cca04a70dfa service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:41.845212 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:41.846042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:41.846316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:41.846641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] PATH_INFO: `/v3/users/42dc1ccde7fe4906aa706b3f21c16d56` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:41.847853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dc1ccde7fe4906aa706b3f21c16d56)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:41.850395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:41.899802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dc1ccde7fe4906aa706b3f21c16d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.900519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dc1ccde7fe4906aa706b3f21c16d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.909484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dc1ccde7fe4906aa706b3f21c16d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.922940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dc1ccde7fe4906aa706b3f21c16d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.930673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1a1811f5-5a7c-4cb1-826d-f5f80b398b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dc1ccde7fe4906aa706b3f21c16d56'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:41.937825 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1109/2218] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:41 2022] DELETE /identity/v3/users/42dc1ccde7fe4906aa706b3f21c16d56 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:42.229738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.231162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:42.244363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37fe-bab0-488d-a7f1-74e04885f1b6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.301837 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.302436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.302705 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.302968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] PATH_INFO: `/v3/projects/a9bebb56c6f94569a5bb357805700b20` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.304086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bebb56c6f94569a5bb357805700b20)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.306028 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.358392 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bebb56c6f94569a5bb357805700b20', 'request_id': 'req-50637011-773e-47c3-a896-14c20b36fb13'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:42.360954 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:42.368750 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bebb56c6f94569a5bb357805700b20', 'request_id': 'req-50637011-773e-47c3-a896-14c20b36fb13'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:42.375558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bebb56c6f94569a5bb357805700b20', 'request_id': 'req-50637011-773e-47c3-a896-14c20b36fb13'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:42.387790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] The token cache is being invalidate because project a9bebb56c6f94569a5bb357805700b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:42.388187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:42.388974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50637011-773e-47c3-a896-14c20b36fb13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:42.390674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1110/2219] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:42 2022] DELETE /identity/v3/projects/a9bebb56c6f94569a5bb357805700b20 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:42.395608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.396100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.396222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.417228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:42.418427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:42.432197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:42.483642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1110/2220] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:42.491793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.492075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.492342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.514581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:42.515860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:42.524842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1111/2221] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:42.529617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.540585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dd1a4-d8be-47f4-b508-5251984b258d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.545961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.546583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.546860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.547188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.547845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:48:42.548149 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.549789 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.562645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1111/2222] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:48:42.567386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.578294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70900bd5-05cb-4006-a080-31fe0cc81b5d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.584182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.584799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.585092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.585377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.586016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.588825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.620408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1112/2223] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:42.625476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.637521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aaf9-9323-450f-b955-0607ac5e7239 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.709927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.710743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.711074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.715263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.715263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.715263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.738809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1112/2224] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:42.743433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.755218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99410a-5391-49d9-bd7c-4081fbeac7be admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.760216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.760828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.761150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.761418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.762065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.763710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.774007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1113/2225] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:42.778411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.789310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc781c50-c4d2-42df-9ac5-9e5a5d62e695 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.794975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.795603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.795880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.796151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.796804 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.798467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8a937-2d38-41e7-b7eb-e54ec75ddf4b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.809375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1113/2226] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:42.813868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:42.824814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3aad5-da70-4a89-853e-34ee9fa1ab9c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:42.830726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:42.831409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.831681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.831948 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] PATH_INFO: `/v3/projects/37a796663d0742adafc0df567327c91b/users/dc19ae7f84e343719b3d3700529b2361/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.847729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a796663d0742adafc0df567327c91b, user_id=dc19ae7f84e343719b3d3700529b2361, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:42.850390 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:42.865500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1114/2227] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:42 2022] PUT /identity/v3/projects/37a796663d0742adafc0df567327c91b/users/dc19ae7f84e343719b3d3700529b2361/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:42.877250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:42.877563 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:42.877890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:42.909235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] MFA Rules not processed for user `dc19ae7f84e343719b3d3700529b2361`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:42.910485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:42.979782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1114/2228] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:42.984535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.050061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92ae5-82b0-493b-86c0-78feb8094a7c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.054942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.055588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.055868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.056131 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.056772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.058760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.091315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1115/2229] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:42 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:43.097020 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.111033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bbbaa-0945-4507-8966-8dc51351dde5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.120519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:43.172890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.173547 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.173821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.174104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.174738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.177536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.200910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1115/2230] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:43 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:43.205198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.216634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a4b9-d779-41b1-9387-21975292143f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.222079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.222690 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.222985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.223270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.223919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.225565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.236896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1116/2231] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:43.241575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.252704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba05db-0a84-4439-9f33-d2d5bfe325fe admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.258989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.259676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.259949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.260343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] PATH_INFO: `/v3/projects/bd63288c33b74e129bfcd5242bd28b76/users/4dcedb3766b94ca2b7a0c2c0ebe770a0/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.276972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd63288c33b74e129bfcd5242bd28b76, user_id=4dcedb3766b94ca2b7a0c2c0ebe770a0, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.279814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.298798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1116/2232] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:43 2022] PUT /identity/v3/projects/bd63288c33b74e129bfcd5242bd28b76/users/4dcedb3766b94ca2b7a0c2c0ebe770a0/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:43.300244 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.310507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ae17d-783d-4f14-adf8-ae53fafdd484 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.359275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:43.377047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.377885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.378245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.378594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.379471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.381684 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceb694-57e6-4712-ac30-37413a4726b5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.393261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1117/2233] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:43.397712 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.409215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282e6f0-9bfb-4c9e-89be-94c140538ba3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.415121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.415770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.416049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.416368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] PATH_INFO: `/v3/projects/bd63288c33b74e129bfcd5242bd28b76/users/4dcedb3766b94ca2b7a0c2c0ebe770a0/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.418702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd63288c33b74e129bfcd5242bd28b76, user_id=4dcedb3766b94ca2b7a0c2c0ebe770a0, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.421488 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.433117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1117/2234] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:43 2022] PUT /identity/v3/projects/bd63288c33b74e129bfcd5242bd28b76/users/4dcedb3766b94ca2b7a0c2c0ebe770a0/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:43.443715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.443993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.444265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.473921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] MFA Rules not processed for user `4dcedb3766b94ca2b7a0c2c0ebe770a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:43.475138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:43.548597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1118/2235] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:43.560550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.562578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:43.624006 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c113-b5e3-43da-957b-41b8a5bc4ba3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.627871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.628482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.628740 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.629046 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.638877 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.640298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6185-33b6-43db-8784-372545ec07db service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.650063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1118/2236] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:43.680714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.746148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bb66-98f1-4209-9873-a4c7cdf46b73 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:43.751285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:43.751913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.752185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.752459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] PATH_INFO: `/v3/users/dc19ae7f84e343719b3d3700529b2361` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.753601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc19ae7f84e343719b3d3700529b2361)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:43.755506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:43.821150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc19ae7f84e343719b3d3700529b2361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:43.829799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc19ae7f84e343719b3d3700529b2361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:43.841943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc19ae7f84e343719b3d3700529b2361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:43.842592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc19ae7f84e343719b3d3700529b2361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:43.844552 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:43.850156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc19ae7f84e343719b3d3700529b2361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:43.858760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1119/2237] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:43 2022] DELETE /identity/v3/users/dc19ae7f84e343719b3d3700529b2361 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:43.863450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:43.863725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:43.863989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:43.883628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:43.884727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:43.946125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1119/2238] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:43.956312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:43.957959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:44.019103 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6a49f-d28f-4f0b-b20f-58d06914468c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:44.023330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:44.023943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:44.024221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:44.024488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:44.034701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:44.036129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:44.045870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1120/2239] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:44.329269 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:44.331388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:44.348826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ca12a-d141-4d8e-8216-d70df65dc56a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:44.354296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:44.354978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:44.355252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:44.355518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] PATH_INFO: `/v3/projects/37a796663d0742adafc0df567327c91b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:44.356661 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a796663d0742adafc0df567327c91b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:44.358612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:44.361887 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:44.410459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a796663d0742adafc0df567327c91b', 'request_id': 'req-2612d036-8c35-489c-96d4-f75eef1f84e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.420028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a796663d0742adafc0df567327c91b', 'request_id': 'req-2612d036-8c35-489c-96d4-f75eef1f84e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.426076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a796663d0742adafc0df567327c91b', 'request_id': 'req-2612d036-8c35-489c-96d4-f75eef1f84e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.437729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] The token cache is being invalidate because project 37a796663d0742adafc0df567327c91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:44.438015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.438757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.440374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1120/2240] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:44 2022] DELETE /identity/v3/projects/37a796663d0742adafc0df567327c91b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:48:44.445130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:44.455675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a335-16bc-4505-9c89-8bc69983206a service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:44.516921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:44.517591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:44.517865 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:44.518171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] PATH_INFO: `/v3/users/4dcedb3766b94ca2b7a0c2c0ebe770a0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:44.519354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dcedb3766b94ca2b7a0c2c0ebe770a0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:44.521307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:44.574800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dcedb3766b94ca2b7a0c2c0ebe770a0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.584000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dcedb3766b94ca2b7a0c2c0ebe770a0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.596835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dcedb3766b94ca2b7a0c2c0ebe770a0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.597621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dcedb3766b94ca2b7a0c2c0ebe770a0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.605174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bd09481-5f03-4cb7-ab57-6730df015171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dcedb3766b94ca2b7a0c2c0ebe770a0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:44.612324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1121/2241] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:44 2022] DELETE /identity/v3/users/4dcedb3766b94ca2b7a0c2c0ebe770a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:44.900474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:44.900474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:44.915122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612d036-8c35-489c-96d4-f75eef1f84e3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:44.975798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:44.976417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:44.976688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:44.977085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] PATH_INFO: `/v3/projects/bd63288c33b74e129bfcd5242bd28b76` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:44.978377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd63288c33b74e129bfcd5242bd28b76)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:44.980628 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.030113 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd63288c33b74e129bfcd5242bd28b76', 'request_id': 'req-9228f323-d88d-4e8c-bd24-e48ddbb57939'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:45.040503 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd63288c33b74e129bfcd5242bd28b76', 'request_id': 'req-9228f323-d88d-4e8c-bd24-e48ddbb57939'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:45.046544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd63288c33b74e129bfcd5242bd28b76', 'request_id': 'req-9228f323-d88d-4e8c-bd24-e48ddbb57939'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:45.058472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] The token cache is being invalidate because project bd63288c33b74e129bfcd5242bd28b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:45.058761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:45.059480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9228f323-d88d-4e8c-bd24-e48ddbb57939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:45.061351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1121/2242] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:44 2022] DELETE /identity/v3/projects/bd63288c33b74e129bfcd5242bd28b76 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:45.066331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.066624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.066898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.088002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:45.089178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:45.098868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:45.154843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1122/2243] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:45.163860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.164234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.164571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.186157 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:45.187500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:45.196748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1122/2244] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:45.201314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.211565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf29154-b19f-4739-bb8a-7b09c0d58af4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.216943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.217595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.217870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.218138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.218788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:48:45.219084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.220843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.233492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1123/2245] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:48:45.238011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.248063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7673ab8-9eb1-4159-8b2e-df63be4b3759 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.253820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.254672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.254876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.255170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.255790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.257770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.273585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:45.292479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1123/2246] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:45.295674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.306241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb76c-4f74-4bb0-9a6a-3a0e62c8dcdd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.363293 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.363913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.364181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.364450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.365136 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.367048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.390257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1124/2247] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:45.394559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.405567 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae910-3afa-4a7d-a0de-caf528a5ef7f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.410845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.411456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.411729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.411992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.412636 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.414336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.425968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1124/2248] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:45.429872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.439947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4f201-dc75-4fe7-af12-0b1529d44542 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.445148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.445754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.446001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.446271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.446911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.448587 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419bc7-5584-463b-9d2d-926c560a41b7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.459230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1125/2249] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:45.463314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.473632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3761f8b-b012-4791-aadf-26c528a4ce90 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.478469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.479286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.479585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.479854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] PATH_INFO: `/v3/projects/015439cd95be4b5e9df9918c20cdbc0d/users/108cc70253b2484ca220ce81005d0ddb/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.494776 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015439cd95be4b5e9df9918c20cdbc0d, user_id=108cc70253b2484ca220ce81005d0ddb, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.497401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.513642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1125/2250] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:45 2022] PUT /identity/v3/projects/015439cd95be4b5e9df9918c20cdbc0d/users/108cc70253b2484ca220ce81005d0ddb/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:45.524428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.524712 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.525023 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.554435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] MFA Rules not processed for user `108cc70253b2484ca220ce81005d0ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:45.555658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:45.626683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1126/2251] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:45.631729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.701590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e32666-1a3d-44c3-94fe-75e46af89544 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.706879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.707485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.707758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.708023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.708662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.710603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.739004 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1126/2252] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:45.743317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.754861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e2fc9-d7b2-4d87-88e7-448615a627a1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.759817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:45.813862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.814483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.814740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.815037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.815669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.817610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.840007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1127/2253] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:45 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:48:45.845927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.861836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bde1-e17b-4e97-af0c-d613a531d002 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.869304 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.870009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.870284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.870548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.871190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.872797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.883435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1127/2254] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:45.887679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.898360 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da19c-768f-4f18-adfc-7ad8a3cd0209 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:45.904077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:45.904729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:45.905041 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:45.905318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] PATH_INFO: `/v3/projects/37a1a52e78cc44f288791157d46395cb/users/5a1b7d853b6241008a3950e1acd062bb/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:45.920727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a1a52e78cc44f288791157d46395cb, user_id=5a1b7d853b6241008a3950e1acd062bb, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:45.923420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:45.939859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1128/2255] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:45 2022] PUT /identity/v3/projects/37a1a52e78cc44f288791157d46395cb/users/5a1b7d853b6241008a3950e1acd062bb/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:45.944464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:45.959790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2678905-3e74-4137-aaeb-23732920631f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:46.016824 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:46.017378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:46.017642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:46.017912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:46.018546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:46.020145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a69749-d586-40e7-acb0-afb7e1316ea6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:46.030397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1128/2256] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:46.036045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:46.046900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9cda7-d4cd-4fb6-aff7-9db4faa26de8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:46.051943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:46.052570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:46.052866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:46.053164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] PATH_INFO: `/v3/projects/37a1a52e78cc44f288791157d46395cb/users/5a1b7d853b6241008a3950e1acd062bb/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:46.055226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a1a52e78cc44f288791157d46395cb, user_id=5a1b7d853b6241008a3950e1acd062bb, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:46.057944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:46.068582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1129/2257] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:46 2022] PUT /identity/v3/projects/37a1a52e78cc44f288791157d46395cb/users/5a1b7d853b6241008a3950e1acd062bb/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:46.079354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:46.079634 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:46.079907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:46.108663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] MFA Rules not processed for user `5a1b7d853b6241008a3950e1acd062bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:46.109967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:46.127041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:46.181618 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1129/2258] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:46.192934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:46.195441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:46.256955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67549b24-2599-4cf7-aa2a-92b532f9d868 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:46.261544 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:46.262143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:46.262412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:46.262673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:46.272965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:46.274624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:46.284987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1130/2259] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:46.365261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:46.366772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:46.387822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309d18-ba37-45ba-b458-df91f7fe7684 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:46.391898 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:46.392498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:46.392766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:46.393040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:46.462072 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:46.463608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:46.472819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1130/2260] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:49.557433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:49.569955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c13f6-50ad-48d8-8ae5-28356471572e service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:49.574562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:49.575190 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:49.575460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:49.575720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:49.577977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:49.640723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:49.642174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276dfac-f287-4e1b-86f6-33ec9268f7c6 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:49.651036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1131/2261] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:50.623350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:50.687920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eab410-32bb-412a-9669-76da041d7392 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:50.693484 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:50.694111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:50.694749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:50.695034 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] PATH_INFO: `/v3/users/108cc70253b2484ca220ce81005d0ddb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:50.696203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108cc70253b2484ca220ce81005d0ddb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:50.698223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:50.753274 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108cc70253b2484ca220ce81005d0ddb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:50.753881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108cc70253b2484ca220ce81005d0ddb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:50.763052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108cc70253b2484ca220ce81005d0ddb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:50.764248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:50.776947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108cc70253b2484ca220ce81005d0ddb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:50.783856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108cc70253b2484ca220ce81005d0ddb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:50.789822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1131/2262] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:50 2022] DELETE /identity/v3/users/108cc70253b2484ca220ce81005d0ddb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:50.794499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:50.794993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:50.795122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:50.803545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:50.819154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:50.820741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:50.883468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1132/2263] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:50.893799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:50.895343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:50.959362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d4b0-0f94-4f3b-b6f4-1d495da5eb24 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:50.963413 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:50.964013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:50.964289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:50.964559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:50.974144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:50.975595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:50.985333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1132/2264] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:48:51.262019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:51.263619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:51.277532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d28f-d57a-456d-bea2-9fec283ce5dd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:51.283619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:51.284400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:51.284678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:51.284974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] PATH_INFO: `/v3/projects/015439cd95be4b5e9df9918c20cdbc0d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:51.286479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015439cd95be4b5e9df9918c20cdbc0d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:51.288333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:51.340328 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015439cd95be4b5e9df9918c20cdbc0d', 'request_id': 'req-33c23540-bdf6-4258-9d3a-9d7b9dc13875'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.348706 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015439cd95be4b5e9df9918c20cdbc0d', 'request_id': 'req-33c23540-bdf6-4258-9d3a-9d7b9dc13875'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.354277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015439cd95be4b5e9df9918c20cdbc0d', 'request_id': 'req-33c23540-bdf6-4258-9d3a-9d7b9dc13875'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.365256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] The token cache is being invalidate because project 015439cd95be4b5e9df9918c20cdbc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:51.365539 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.366200 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.367697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1133/2265] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:51 2022] DELETE /identity/v3/projects/015439cd95be4b5e9df9918c20cdbc0d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:51.371827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:51.382152 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff598c-824e-4860-bf65-d706ed70283b service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:51.442231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:51.442858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:51.443125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:51.443394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] PATH_INFO: `/v3/users/5a1b7d853b6241008a3950e1acd062bb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:51.444919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1b7d853b6241008a3950e1acd062bb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:51.446871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:51.493610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1b7d853b6241008a3950e1acd062bb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.494254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1b7d853b6241008a3950e1acd062bb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.503640 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1b7d853b6241008a3950e1acd062bb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.516585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1b7d853b6241008a3950e1acd062bb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.522549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:51.525777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-62c86b2e-c8f4-461f-ae5d-3d849377c5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1b7d853b6241008a3950e1acd062bb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.533489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1133/2266] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:48:51 2022] DELETE /identity/v3/users/5a1b7d853b6241008a3950e1acd062bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:51.817138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:51.818723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:51.834227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c23540-bdf6-4258-9d3a-9d7b9dc13875 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:51.900646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:51.901326 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:51.901752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:51.901945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] PATH_INFO: `/v3/projects/37a1a52e78cc44f288791157d46395cb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:51.903578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a1a52e78cc44f288791157d46395cb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:51.905512 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:51.939152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:51.956222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a1a52e78cc44f288791157d46395cb', 'request_id': 'req-a7b5a2ff-372f-4996-a8ab-900afb826c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.964050 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a1a52e78cc44f288791157d46395cb', 'request_id': 'req-a7b5a2ff-372f-4996-a8ab-900afb826c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.970355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a1a52e78cc44f288791157d46395cb', 'request_id': 'req-a7b5a2ff-372f-4996-a8ab-900afb826c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.981756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] The token cache is being invalidate because project 37a1a52e78cc44f288791157d46395cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:48:51.982027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.982667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a7b5a2ff-372f-4996-a8ab-900afb826c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:48:51.984183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1134/2267] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:48:51 2022] DELETE /identity/v3/projects/37a1a52e78cc44f288791157d46395cb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:51.989270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:51.989834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:51.989834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.012956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:52.014252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:52.075057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1134/2268] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:52.083982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.085316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.085657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.112859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:52.114160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:52.122248 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1135/2269] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:52.126873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.137101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8ce0d-cbc0-4946-ac26-3d0874b7df6b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.141697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.142301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.142578 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.142827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.143476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:48:52.143769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.145403 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.157186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1135/2270] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:48:52.161850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.171012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f155d07-d24b-43e0-981c-e64803ff1173 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.176102 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.176693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.177025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.177318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.177944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.179854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.208346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1136/2271] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:52.212364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.222549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934845-5bfb-4a6c-92f8-8c58be1debea admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.277062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.277678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.277953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.278220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.278847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.280862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.307599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1136/2272] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:52 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:52.312514 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.328537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69417e-ba37-479d-8ab4-8d74a900fde2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.334557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.335444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.336034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.337116 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.338018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.341441 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.389097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1137/2273] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:52.390556 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.404752 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467da4c-f312-446e-8a52-8118d7068cfd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.416454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.417309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.417749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.418193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.419007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.421223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdd805-2da2-46de-9f5d-34b169879981 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.447823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1137/2274] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:52.449840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.461228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169e830-55b4-454e-aef0-a4ad1f79ae6c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.470319 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.471054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.471332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.471609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] PATH_INFO: `/v3/projects/95175dcbb17546acadd11555f47cb777/users/2cb055af4a35446d889432e1c29aad0b/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.489292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] RBAC: Authorizing `identity:create_grant(project_id=95175dcbb17546acadd11555f47cb777, user_id=2cb055af4a35446d889432e1c29aad0b, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.492117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.518109 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1138/2275] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:52 2022] PUT /identity/v3/projects/95175dcbb17546acadd11555f47cb777/users/2cb055af4a35446d889432e1c29aad0b/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:52.520195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e507-2cb2-4fec-8247-583d0eb8803e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.520478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e507-2cb2-4fec-8247-583d0eb8803e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.520743 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729e507-2cb2-4fec-8247-583d0eb8803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.544466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e729e507-2cb2-4fec-8247-583d0eb8803e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:52.546360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e729e507-2cb2-4fec-8247-583d0eb8803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:52.624107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:52.635487 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1138/2276] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:52.646380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:52.648665 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:52.727685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab82e-7dcd-4df3-b652-9a4a74bb12da admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:52.731841 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:52.732570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:52.733476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:52.733476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:52.748061 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:52.750127 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:52.759885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1139/2277] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:48:53.497894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:53.498846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:53.499265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:53.543311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] MFA Rules not processed for user `2cb055af4a35446d889432e1c29aad0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:53.545057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:53.674607 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1139/2278] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:53.679320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:53.690318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522feff1-f363-4813-ad72-6a389c5100ee service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:53.697603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:53.698515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:53.698951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:53.699379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:53.700167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:53.703629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:53.750486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:53.758499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1140/2279] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:48:53 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:53.766400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135d43-39ac-4579-b2cd-476d71d33642 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:53.873630 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:53.874361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:53.874727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:53.875107 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:53.876170 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:53.879552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:53.913757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1140/2280] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:48:53 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:48:53.918322 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:53.932678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c9bd-8642-4ee5-b28d-ea4b635e118b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:53.940085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:53.940751 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:53.941114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:53.941397 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:53.942045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:53.944097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:53.961794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1141/2281] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:53.963068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:53.974130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3f99-bfc7-43d5-8cb8-8e97ef473eba admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:53.978876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:53.979562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:53.979908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:53.980180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] PATH_INFO: `/v3/projects/4b321e3ab6e94a1288dda61b149c1da5/users/a3416720f09c44e594bf53b7907caec0/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:53.999655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b321e3ab6e94a1288dda61b149c1da5, user_id=a3416720f09c44e594bf53b7907caec0, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:54.002626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:54.019151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1141/2282] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:53 2022] PUT /identity/v3/projects/4b321e3ab6e94a1288dda61b149c1da5/users/a3416720f09c44e594bf53b7907caec0/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:54.023379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:54.034117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81a20-bfff-4f18-bb77-b8dfaaa1b26a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:54.058660 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:54.108618 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397424-3430-4783-8193-4f34574b634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:54.109436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397424-3430-4783-8193-4f34574b634e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:54.109828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397424-3430-4783-8193-4f34574b634e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:54.110202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397424-3430-4783-8193-4f34574b634e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:54.110955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397424-3430-4783-8193-4f34574b634e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:54.113694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397424-3430-4783-8193-4f34574b634e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:54.125977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1142/2283] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:48:54.130161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:54.141130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdd8c-9b45-4337-b647-276114167988 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:54.146370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:54.147049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:54.147322 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:54.147590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] PATH_INFO: `/v3/projects/4b321e3ab6e94a1288dda61b149c1da5/users/a3416720f09c44e594bf53b7907caec0/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:54.149560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b321e3ab6e94a1288dda61b149c1da5, user_id=a3416720f09c44e594bf53b7907caec0, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:54.152263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421048-8fc0-490c-a650-b428346d2be7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:54.164476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1142/2284] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:48:54 2022] PUT /identity/v3/projects/4b321e3ab6e94a1288dda61b149c1da5/users/a3416720f09c44e594bf53b7907caec0/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:48:54.921067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:54.921649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:54.921907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:54.958728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] MFA Rules not processed for user `a3416720f09c44e594bf53b7907caec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:54.961658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:55.133488 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1143/2285] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:48:55.135010 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba71b-0de3-45c0-9958-15223ca84b0c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:55.135557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba71b-0de3-45c0-9958-15223ca84b0c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:55.135557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba71b-0de3-45c0-9958-15223ca84b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:55.163188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fc2ba71b-0de3-45c0-9958-15223ca84b0c None None] MFA Rules not processed for user `2cb055af4a35446d889432e1c29aad0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:55.164760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc2ba71b-0de3-45c0-9958-15223ca84b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:55.210050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:55.231381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1143/2286] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:55.242222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:55.243784 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:55.325464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937b043-964b-419b-a5f4-da49246ab720 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:55.331523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:55.332221 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:55.333520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:55.333520 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:55.343883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:55.346370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:55.357324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1144/2287] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:48:57.113936 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:57.114417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:57.114542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:57.166142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] MFA Rules not processed for user `263600e8ce344a818a71400bb9c5dc37`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:48:57.167819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:57.251256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1144/2288] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:48:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:48:57.805504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:48:57.847498 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:48:57.879769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6261-71c9-49f2-a99d-827837e66600 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:48:57.884265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:48:57.885034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:48:57.885034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:48:57.885257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:48:57.887213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:48:57.898890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:48:57.901199 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:48:57.911667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1145/2289] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:48:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:03.981769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:03.983406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:04.000387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486079d-0013-4d3e-815f-2d0379be604d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:04.006048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:04.006670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:04.007109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:04.007380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:04.009224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:04.021853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:04.023480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:04.034811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1145/2290] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:07.387436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:07.396350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d619985-1938-42b4-8e66-dd4da48bfb03 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:07.400081 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:07.400682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:07.400959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:07.401267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:07.403004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:07.465685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:07.467147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0911fc-4752-4fec-a337-731f5f1f76e8 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:07.479727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1146/2291] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:12.801404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:12.802947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:12.864858 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a950b-33a3-4f38-9f75-4ceabebba778 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:12.868759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:12.869435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:12.869942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:12.870091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:12.880380 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:12.881905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:12.891357 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1146/2292] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:17.472874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=43 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:22.887208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=63 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:25.356696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:25.357289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:25.357406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:25.379986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:25.381354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:25.445820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1147/2293] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:25.495993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:25.497558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:25.565633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3803eb9-1e58-4e11-ba9e-cc20fc7ea98a service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:25.571736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:25.572358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:25.572622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:25.572914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:25.581575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:25.583311 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:25.591579 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1147/2294] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:49:33.498096 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:33.598885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388f10-b839-42da-92e8-048a0d956e9e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:33.604927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:33.605602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:33.606039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:33.606313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] PATH_INFO: `/v3/users/2cb055af4a35446d889432e1c29aad0b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:33.607468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb055af4a35446d889432e1c29aad0b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:33.610404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:33.671653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb055af4a35446d889432e1c29aad0b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:33.686896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb055af4a35446d889432e1c29aad0b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:33.704651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb055af4a35446d889432e1c29aad0b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:33.705416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb055af4a35446d889432e1c29aad0b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:33.712842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb055af4a35446d889432e1c29aad0b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:33.719945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1148/2295] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:49:33 2022] DELETE /identity/v3/users/2cb055af4a35446d889432e1c29aad0b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:33.923853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:33.946450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88985284-e047-41d2-8d4b-bf1625e53c51 service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:34.014171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:34.015189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.015648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.016104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] PATH_INFO: `/v3/projects/95175dcbb17546acadd11555f47cb777` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.017340 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=95175dcbb17546acadd11555f47cb777)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:34.019302 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:34.073599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95175dcbb17546acadd11555f47cb777', 'request_id': 'req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.084155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95175dcbb17546acadd11555f47cb777', 'request_id': 'req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.097137 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95175dcbb17546acadd11555f47cb777', 'request_id': 'req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.102755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] The token cache is being invalidate because project 95175dcbb17546acadd11555f47cb777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:49:34.103067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.103687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.105429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1148/2296] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:49:33 2022] DELETE /identity/v3/projects/95175dcbb17546acadd11555f47cb777 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:34.109470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:34.110997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:34.125040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d44e-cffe-4ada-b7c9-a879a973197b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:34.147834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:34.190565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:34.191316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.191594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.191862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] PATH_INFO: `/v3/users/a3416720f09c44e594bf53b7907caec0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.193152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3416720f09c44e594bf53b7907caec0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:34.195507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:34.250593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3416720f09c44e594bf53b7907caec0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.282802 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3416720f09c44e594bf53b7907caec0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.307316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3416720f09c44e594bf53b7907caec0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.308057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3416720f09c44e594bf53b7907caec0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.316698 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-52e625fe-fb60-4130-b70d-5accb9a65edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3416720f09c44e594bf53b7907caec0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.323874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1149/2297] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:49:34 2022] DELETE /identity/v3/users/a3416720f09c44e594bf53b7907caec0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:34.517237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:34.521845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:34.536550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa15790-9bf9-440e-bb91-cf0ee237e7ba admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:34.560809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:34.619561 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:34.620241 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.620583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.620874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] PATH_INFO: `/v3/projects/4b321e3ab6e94a1288dda61b149c1da5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.622063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b321e3ab6e94a1288dda61b149c1da5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:34.624003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:34.680498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b321e3ab6e94a1288dda61b149c1da5', 'request_id': 'req-fe39b42e-72f4-4747-ba25-6d953d5d0a82'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.690285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b321e3ab6e94a1288dda61b149c1da5', 'request_id': 'req-fe39b42e-72f4-4747-ba25-6d953d5d0a82'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.700404 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b321e3ab6e94a1288dda61b149c1da5', 'request_id': 'req-fe39b42e-72f4-4747-ba25-6d953d5d0a82'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.715159 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] The token cache is being invalidate because project 4b321e3ab6e94a1288dda61b149c1da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:49:34.715517 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.716433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-fe39b42e-72f4-4747-ba25-6d953d5d0a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:34.721383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1149/2298] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:49:34 2022] DELETE /identity/v3/projects/4b321e3ab6e94a1288dda61b149c1da5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:34.723087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.723551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.723634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.749872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:34.751382 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:34.837408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1150/2299] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:34.840566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.840851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.841242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.863724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:34.864953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:34.875062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1150/2300] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:49:34.879434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:34.891490 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368418a-2e6e-4bf7-8025-614b76635fc6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:34.902549 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:34.903455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.903769 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.904059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.904704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:49:34.905021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:34.907161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:34.923181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1151/2301] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:49:34.924465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:34.934121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85ee8-a997-42d0-980a-2f6f34dbea1a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:34.938838 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:34.939438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:34.939718 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:34.940078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:34.940679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:34.942616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:34.973521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1151/2302] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:49:34 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:49:34.977973 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:34.988761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec13197-336f-4f35-a3ce-e1d4bfd91e82 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.024537 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:35.058396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.059039 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.059315 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.059581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.060235 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.062369 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.094303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1152/2303] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:49:34 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:49:35.098478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.109337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d243-a1db-4c24-8f77-df015ef17ee4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.114189 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.114794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.115071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.115398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.115971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.117638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.130469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1152/2304] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:49:35.134268 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.144827 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd021df-28be-4330-8241-c4ad33767a8d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.149516 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.150120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.150395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.150670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.151309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.152896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d27bb-44ec-4357-966a-765f49217cde admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.165154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1153/2305] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:49:35.169514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.180146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5792f-9ae0-4c86-9314-2c6c77c9cfbb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.185016 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.186051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.186051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.186210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] PATH_INFO: `/v3/projects/ec4e8436f5364e95a7d2cb0d33efa704/users/476ab639ea564699b4581e9542672d12/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.204067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4e8436f5364e95a7d2cb0d33efa704, user_id=476ab639ea564699b4581e9542672d12, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.207235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.221463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1153/2306] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:49:35 2022] PUT /identity/v3/projects/ec4e8436f5364e95a7d2cb0d33efa704/users/476ab639ea564699b4581e9542672d12/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:35.287572 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.287840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.288113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.319176 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] MFA Rules not processed for user `476ab639ea564699b4581e9542672d12`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:35.320395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:35.385634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1154/2307] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:35.397400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.399482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:35.455837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:35.463353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc63e0-c2c4-40ff-9e7d-6d2d6ffd2d4c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.468429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.469244 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.469519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.469780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.478860 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.480310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672e31-f0d2-4fc5-b69c-3adb9e2f8c46 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.489397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1154/2308] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:35.511847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.578289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4ba5a-c3f5-409c-b54d-a390641a6702 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.583900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.584534 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.584810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.585125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] PATH_INFO: `/v3/users/476ab639ea564699b4581e9542672d12` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.586289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] RBAC: Authorizing `identity:delete_user(user_id=476ab639ea564699b4581e9542672d12)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.588205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.632173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:35.638163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476ab639ea564699b4581e9542672d12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:35.647045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476ab639ea564699b4581e9542672d12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:35.658753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476ab639ea564699b4581e9542672d12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:35.659408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476ab639ea564699b4581e9542672d12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:35.666373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476ab639ea564699b4581e9542672d12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:35.672643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1155/2309] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:49:35 2022] DELETE /identity/v3/users/476ab639ea564699b4581e9542672d12 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:35.677437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.677716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.677982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.697923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:35.699124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:35.765249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1155/2310] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:35.775122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:35.776700 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:35.838364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64bf86-9b4c-4b8c-937d-375b831d074e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:35.842826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:35.843470 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:35.843746 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:35.844011 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:35.853729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:35.855183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f2a7-34c8-4c25-882a-8bd184930aae service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:35.865210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1156/2311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:36.182456 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.183985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:36.208281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a67ed4-9a0b-4426-91da-35802a27e9d0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.214466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.215179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.215518 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.215857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] PATH_INFO: `/v3/projects/ec4e8436f5364e95a7d2cb0d33efa704` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.217102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4e8436f5364e95a7d2cb0d33efa704)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.219067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.265709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4e8436f5364e95a7d2cb0d33efa704', 'request_id': 'req-056a3396-640b-4d2a-940e-c99cf40eb670'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:36.274261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4e8436f5364e95a7d2cb0d33efa704', 'request_id': 'req-056a3396-640b-4d2a-940e-c99cf40eb670'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:36.279951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4e8436f5364e95a7d2cb0d33efa704', 'request_id': 'req-056a3396-640b-4d2a-940e-c99cf40eb670'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:36.291313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] The token cache is being invalidate because project ec4e8436f5364e95a7d2cb0d33efa704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:49:36.291597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:36.292234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-056a3396-640b-4d2a-940e-c99cf40eb670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:36.293773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1156/2312] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:49:36 2022] DELETE /identity/v3/projects/ec4e8436f5364e95a7d2cb0d33efa704 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:36.298960 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.299304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.300349 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.320567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:36.321809 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:36.384852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1157/2313] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:36.392401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.392760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.393133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.414673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:36.415885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:36.423920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1157/2314] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:36.428367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.438378 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a291146-432b-43ce-899b-52784d4b39ff None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.442918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.443917 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.444194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.444460 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.445151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:49:36.445476 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.447037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.459055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1158/2315] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:49:36.463467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.472829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73666d2f-2f13-481d-abd8-80d091d33985 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.477975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.478596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.478867 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.479192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.479823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.481777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.511019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1158/2316] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:49:36 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:49:36.515159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.525451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5826-9ee4-4733-9df5-cf10cd54234e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.574556 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:36.587897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.588548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.588820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.589120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.589765 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.591688 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.613218 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1159/2317] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:49:36 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:49:36.617240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.627686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e69b-b5f5-4e4b-9a85-dab405b0f111 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.632265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.632845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.633158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.633429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.634078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.635681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.645794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1159/2318] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:49:36.650097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.660323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c6d4d-309d-4a44-838c-142c1b95eade admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.665830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.666443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.666711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.666977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.667619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.669254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21455ed-1f87-46f7-bf6a-9b582deaf8b3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.680373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1160/2319] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:49:36.684516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.695398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721b6ed-33a1-4fa0-a8db-6e7bf00b9f30 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.700453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.701133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.701405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.701649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] PATH_INFO: `/v3/projects/78df12fbbab842b6b193164ec0875bff/users/ad52912e8c824d939a409f93761ea309/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.716736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78df12fbbab842b6b193164ec0875bff, user_id=ad52912e8c824d939a409f93761ea309, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.719473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.734627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1160/2320] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:49:36 2022] PUT /identity/v3/projects/78df12fbbab842b6b193164ec0875bff/users/ad52912e8c824d939a409f93761ea309/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:49:36.746285 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3adcd3-330d-4c91-ae0b-53dd9d8cf49d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.746597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3adcd3-330d-4c91-ae0b-53dd9d8cf49d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.746866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3adcd3-330d-4c91-ae0b-53dd9d8cf49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.775339 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ec3adcd3-330d-4c91-ae0b-53dd9d8cf49d None None] MFA Rules not processed for user `ad52912e8c824d939a409f93761ea309`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:36.776546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ec3adcd3-330d-4c91-ae0b-53dd9d8cf49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:36.845324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1161/2321] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:36.856535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:36.858683 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:36.870932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:36.930181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e16bce-2263-48c2-8ee4-c3845ba4ab22 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:36.934425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:36.935041 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:36.935310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:36.935569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:36.947787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:36.949968 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e391b-0a32-457d-acc3-6a9248eb22be service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:36.961450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1161/2322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:40.693373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:40.694430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:40.694430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:40.695654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1162/2323] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:49:40.701851 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458daf-a4d3-4a17-8181-a2874d131753 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:40.702679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458daf-a4d3-4a17-8181-a2874d131753 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:40.703039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43458daf-a4d3-4a17-8181-a2874d131753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:40.727106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-43458daf-a4d3-4a17-8181-a2874d131753 None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:40.728333 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-43458daf-a4d3-4a17-8181-a2874d131753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:40.805653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1162/2324] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:49:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:40.817346 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:40.819655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:40.887210 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97e40-99ff-4d5b-b2a5-3f6f9a1f8c9b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:40.891272 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70f7e360a0824d328c393df1eacbc06e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:40.891884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:40.892157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:40.892425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:40.903697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:40.905153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ce1ea-7059-47bb-a88b-cfa29a4b909a service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:40.915923 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1163/2325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:40.991186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:40.991473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:40.991729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:40.993134 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1163/2326] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 06:49:40.998029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e043-4be5-46f0-b887-a3bfd1c420e7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:40.998318 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e043-4be5-46f0-b887-a3bfd1c420e7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:40.998576 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e043-4be5-46f0-b887-a3bfd1c420e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:41.019249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6056e043-4be5-46f0-b887-a3bfd1c420e7 None None] MFA Rules not processed for user `f0294ac726964601b44f1d63cb1c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:41.020504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6056e043-4be5-46f0-b887-a3bfd1c420e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:41.074467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1164/2327] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:49:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:41.086222 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:41.088151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:41.102290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006561-c47d-4f89-b68e-cb1f80f52fe3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:41.106708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:41.107279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:41.107546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:41.107834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:41.115446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:41.116873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20017147-bc6f-484e-8f43-92614c9f2b82 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:41.124910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1164/2328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:41.213883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1d38-e940-4070-9b26-147c1191398d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:41.214168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1d38-e940-4070-9b26-147c1191398d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:41.214437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1d38-e940-4070-9b26-147c1191398d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:41.215776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1165/2329] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 11 06:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 06:49:41.224142 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:41.224423 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:41.224695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:41.245155 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] MFA Rules not processed for user `965ff63b01c04728b214e71933f87792`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:41.246372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:41.257049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1165/2330] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 11 06:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:41.267683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1d38-e940-4070-9b26-147c1191398d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:41.269670 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-475b1d38-e940-4070-9b26-147c1191398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:41.283880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1d38-e940-4070-9b26-147c1191398d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:41.287950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:41.288551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:41.288821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:41.289128 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:41.297793 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:41.300630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:41.302227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfca0ec-e1b7-4261-a914-b08577b8ab91 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:41.315624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1166/2331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:42.399701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:42.466032 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c198f3-d9ca-4dd1-a6ac-ebcf3faa5c2c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:42.470890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:42.471520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:42.471794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:42.472118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] PATH_INFO: `/v3/users/ad52912e8c824d939a409f93761ea309` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:42.473299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad52912e8c824d939a409f93761ea309)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:42.475221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:42.504801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:42.526283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad52912e8c824d939a409f93761ea309'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:42.526931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad52912e8c824d939a409f93761ea309'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:42.535548 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad52912e8c824d939a409f93761ea309'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:42.549172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad52912e8c824d939a409f93761ea309'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:42.556000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad52912e8c824d939a409f93761ea309'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:42.562511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1166/2332] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:49:42 2022] DELETE /identity/v3/users/ad52912e8c824d939a409f93761ea309 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:42.566881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:42.567362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:42.567362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:42.588459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:42.589632 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:42.650533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1167/2333] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:42.660678 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:42.662181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:42.719849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77b9cd-b0c9-44b5-b501-f3898f359aab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:42.723767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:42.724375 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:42.724645 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:42.724905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:42.734360 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:42.735785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c24b83-c210-4c67-8da5-b8f29a41bc89 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:42.746050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1167/2334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:49:43.015850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.017290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.033209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010a393-1c70-4fb1-b3b5-4d11dc80d964 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.039420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.040146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.040436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.040704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] PATH_INFO: `/v3/projects/78df12fbbab842b6b193164ec0875bff` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.041992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78df12fbbab842b6b193164ec0875bff)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.044275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.094943 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78df12fbbab842b6b193164ec0875bff', 'request_id': 'req-38876d6f-746a-462d-baff-9428511d9899'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:43.103068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78df12fbbab842b6b193164ec0875bff', 'request_id': 'req-38876d6f-746a-462d-baff-9428511d9899'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:43.111243 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78df12fbbab842b6b193164ec0875bff', 'request_id': 'req-38876d6f-746a-462d-baff-9428511d9899'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:43.124076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] The token cache is being invalidate because project 78df12fbbab842b6b193164ec0875bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:49:43.124367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:43.125042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-38876d6f-746a-462d-baff-9428511d9899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:43.126995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1168/2335] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:49:43 2022] DELETE /identity/v3/projects/78df12fbbab842b6b193164ec0875bff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:43.131653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373c37-079b-457d-8f5b-e0e318a2ef4d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.131947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373c37-079b-457d-8f5b-e0e318a2ef4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.132200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373c37-079b-457d-8f5b-e0e318a2ef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.154467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2d373c37-079b-457d-8f5b-e0e318a2ef4d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:43.155665 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2d373c37-079b-457d-8f5b-e0e318a2ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.180333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.180610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.180883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.205651 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:43.206904 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.221768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1168/2336] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:43.229651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.229937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.230206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.250125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:43.251334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.259495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1169/2337] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:43.263560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.263998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1169/2338] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:49:43.272754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3031-676f-45ef-a24f-95cc9fdea81c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.275600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.276963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.277376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.277975 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.278248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.278514 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.279181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:49:43.279479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.281093 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.293530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1170/2339] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 06:49:43.298112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.306122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:43.309955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4abe38-e0a6-465f-90a4-ee1a5fd91975 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.316140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.316854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.317165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.317432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.318057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.320321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.351438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1171/2340] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:49:43.351638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2ab7a-dfb7-4245-8db7-2d6650e7dc83 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.352532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.358494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:43.410584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.411079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.411379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.411646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.416175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2c11-c50c-4fc1-bd37-28b8506e1427 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.421310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.421921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.422197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.422467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.423092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.425049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.451576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1172/2341] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:49:43.452582 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.462084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705865-65e9-437a-a823-b40166ec4955 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.466790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.467374 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.467646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.467911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.468549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.470186 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.470545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.472653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.482987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1173/2342] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:49:43.483168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1170/2343] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 06:49:43.484008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.494180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a34253-911b-47ad-819e-61064bb21dcf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.499051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.499638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.499908 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.500280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.501051 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.502879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531316f-665c-46a4-8af8-d7c292f2892d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.514443 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1174/2344] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:49:43.519171 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.530745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16785dc6-a7a1-454d-8de9-246c280c96d1 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.535425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.536130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.536571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.536811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] PATH_INFO: `/v3/projects/ee38e7d2ef8548f69006b03c715c5578/users/548a75f96395447ea46a10afce1884ee/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.576222 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee38e7d2ef8548f69006b03c715c5578, user_id=548a75f96395447ea46a10afce1884ee, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.581951 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.611820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1171/2345] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:49:43 2022] PUT /identity/v3/projects/ee38e7d2ef8548f69006b03c715c5578/users/548a75f96395447ea46a10afce1884ee/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:43.612050 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.612409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.612746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.673597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] MFA Rules not processed for user `548a75f96395447ea46a10afce1884ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:43.678379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.786307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1175/2346] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:49:43.803747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:43.806037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:43.877509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:43.889978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acc84-cf7f-4c1c-91be-c4e8cbf41c16 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:43.894057 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:43.894748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:43.895089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:43.895422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:43.905985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:43.912484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d15841-4546-4d54-90f4-49308164f5ab service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:43.924817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1172/2347] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:49:46.579303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:46.642986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3da33-4047-4f0b-9ebb-8ef71478e411 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:46.647787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:46.648416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:46.648688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:46.648952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] PATH_INFO: `/v3/users/548a75f96395447ea46a10afce1884ee` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:46.650116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=548a75f96395447ea46a10afce1884ee)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:46.652043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:46.654897 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:46.707854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548a75f96395447ea46a10afce1884ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:46.708643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548a75f96395447ea46a10afce1884ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:46.720071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548a75f96395447ea46a10afce1884ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:46.736986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548a75f96395447ea46a10afce1884ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:46.745616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548a75f96395447ea46a10afce1884ee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:46.770584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1176/2348] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:49:46 2022] DELETE /identity/v3/users/548a75f96395447ea46a10afce1884ee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:46.775001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:46.775543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:46.775543 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:46.812591 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:49:46.817501 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:46.884022 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1173/2349] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:49:46.893986 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:46.895475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:46.958519 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812d39-3479-49bb-8d64-cff529376eda admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:46.963320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:46.963933 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:46.964182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:46.964445 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:46.974257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:46.975701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb296e0-c28f-43d2-8014-0a3661e83c76 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:46.985730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1177/2350] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:49:47.523972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:49:47.525504 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:49:47.538139 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861fd6a-93bf-487c-8de6-3958b0d5d550 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:49:47.542956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:49:47.543625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:49:47.543903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:49:47.544157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] PATH_INFO: `/v3/projects/ee38e7d2ef8548f69006b03c715c5578` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:49:47.545395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee38e7d2ef8548f69006b03c715c5578)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:49:47.547358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:49:47.622968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee38e7d2ef8548f69006b03c715c5578', 'request_id': 'req-4fee1e80-b444-46ef-a4c6-5f3784480aeb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:47.631718 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee38e7d2ef8548f69006b03c715c5578', 'request_id': 'req-4fee1e80-b444-46ef-a4c6-5f3784480aeb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:47.637992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee38e7d2ef8548f69006b03c715c5578', 'request_id': 'req-4fee1e80-b444-46ef-a4c6-5f3784480aeb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:47.651935 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] The token cache is being invalidate because project ee38e7d2ef8548f69006b03c715c5578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:49:47.652249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:47.653025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:49:47.655124 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1174/2351] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:49:47 2022] DELETE /identity/v3/projects/ee38e7d2ef8548f69006b03c715c5578 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:49:56.981281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:49:57.648373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:08.330280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:50:08.330763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:50:08.330869 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:50:08.371390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:50:08.372639 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:08.454872 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1178/2352] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:50:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:50:08.468134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:50:08.469726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:08.569033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee1e80-b444-46ef-a4c6-5f3784480aeb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:50:08.574252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:50:08.574866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:50:08.575135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:50:08.575402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:50:08.583999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:50:08.585594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:50:08.594565 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1175/2353] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:50:12.939102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:50:12.940856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:13.036861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873714-cfd7-48a5-9dae-d56fb167e090 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:50:13.042633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:50:13.043231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:50:13.043502 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:50:13.043764 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:50:13.045703 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:13.057803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:50:13.060112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:50:13.071421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1179/2354] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:50:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:50:18.591294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=43 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:23.066377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=86 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:50:57.095868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:50:57.097406 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:57.177193 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bceda-0fd6-43f7-94a1-15d3f53a4b15 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:50:57.181165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:50:57.181767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:50:57.182036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:50:57.182301 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:50:57.184152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:50:57.286925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:50:57.288373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:50:57.309696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1176/2355] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:00.499207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:00.500910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:00.515935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8610c-83e4-419f-bb28-fc6a39f085dc service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:00.520434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:00.521301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:00.521572 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:00.521835 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] PATH_INFO: `/v3/users/263600e8ce344a818a71400bb9c5dc37` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:00.523060 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=263600e8ce344a818a71400bb9c5dc37)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:00.524969 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:00.573455 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263600e8ce344a818a71400bb9c5dc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.574224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263600e8ce344a818a71400bb9c5dc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.583525 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263600e8ce344a818a71400bb9c5dc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.596179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263600e8ce344a818a71400bb9c5dc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.603148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-98049c49-caf8-4c44-abe9-1dbdbea4cd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263600e8ce344a818a71400bb9c5dc37'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.609228 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1180/2356] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:00 2022] DELETE /identity/v3/users/263600e8ce344a818a71400bb9c5dc37 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:00.787766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:00.799184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae0a88-6179-4c2c-ac6a-8413c85c8aab service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:00.859073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:00.859708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:00.859980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:00.860232 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] PATH_INFO: `/v3/projects/d0db9f400b4f429fbcf4c4052ede9b09` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:00.861469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0db9f400b4f429fbcf4c4052ede9b09)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:00.863364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:00.865582 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:00.916125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0db9f400b4f429fbcf4c4052ede9b09', 'request_id': 'req-1064d405-958a-4dc6-8f8c-95187bfa7ea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.925604 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0db9f400b4f429fbcf4c4052ede9b09', 'request_id': 'req-1064d405-958a-4dc6-8f8c-95187bfa7ea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.931122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0db9f400b4f429fbcf4c4052ede9b09', 'request_id': 'req-1064d405-958a-4dc6-8f8c-95187bfa7ea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.942754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] The token cache is being invalidate because project d0db9f400b4f429fbcf4c4052ede9b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:00.943036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.943682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1064d405-958a-4dc6-8f8c-95187bfa7ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:00.945196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1177/2357] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:00 2022] DELETE /identity/v3/projects/d0db9f400b4f429fbcf4c4052ede9b09 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:00.950314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:00.950595 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:00.950861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.011350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:01.012489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:01.073699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1181/2358] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:01.082557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.082842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.083112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.103558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:01.104773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:01.113163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1178/2359] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:01.117448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.127623 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c765a4-0029-4f6d-b157-af68c85f7a51 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.133119 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.133757 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.134029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.134294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.134947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:01.135246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.136879 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.148590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1182/2360] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:01.152857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.162290 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b98b36-12ca-401f-9cc3-86831dfb4968 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.167609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.168211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.168486 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.168748 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.169432 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.171367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.200907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1179/2361] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:01 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:01.205211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.215657 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216713c-ca02-4a9d-b647-442abbe53b69 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.242508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:01.278826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.279367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.279648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.279917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.280551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.282590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.307294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1183/2362] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:01 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:01.311527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.322945 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11666ee-11c4-4eda-aaa3-318e81c82e9e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.328321 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.329048 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.329384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.329794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.330493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.332194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.342940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1180/2363] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:01.349780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.362478 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd42c3-9079-472c-b343-608db1b01ab5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.368389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.369067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.369395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.369603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.370257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.371862 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b32229-9cdb-44de-a136-e2700220034b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.382895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1184/2364] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:01.387242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.397959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067075d-c45a-442f-9295-16c45cbee3ea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.403100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.403747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.404027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.404302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] PATH_INFO: `/v3/projects/0267c1e10ce04b078ecb8d83ad530a9b/users/6226d826c5f64cbe84a617eb1686f4ea/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.418942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0267c1e10ce04b078ecb8d83ad530a9b, user_id=6226d826c5f64cbe84a617eb1686f4ea, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.421620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.437074 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1181/2365] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:01 2022] PUT /identity/v3/projects/0267c1e10ce04b078ecb8d83ad530a9b/users/6226d826c5f64cbe84a617eb1686f4ea/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:01.442608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe637b-6f6b-461a-96d2-6b6d44b4fc41 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.442915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe637b-6f6b-461a-96d2-6b6d44b4fc41 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.443187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe637b-6f6b-461a-96d2-6b6d44b4fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.464270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5bbe637b-6f6b-461a-96d2-6b6d44b4fc41 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:01.465535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5bbe637b-6f6b-461a-96d2-6b6d44b4fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:01.529559 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1185/2366] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:01.540309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:01.542453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:01.607703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd6860-e4b5-4474-9945-2814dce3984d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:01.613043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:01.613664 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:01.613934 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:01.614198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:01.623588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:01.625021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:01.634593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1182/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:05.321496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891e7e-d39b-4bd2-b03d-7063294f3edd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:05.321982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891e7e-d39b-4bd2-b03d-7063294f3edd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:05.322294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2891e7e-d39b-4bd2-b03d-7063294f3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:05.360247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d2891e7e-d39b-4bd2-b03d-7063294f3edd None None] MFA Rules not processed for user `6226d826c5f64cbe84a617eb1686f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:05.361814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d2891e7e-d39b-4bd2-b03d-7063294f3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:05.443863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1186/2368] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:05.458367 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:05.460160 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:05.514333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:05.614271 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2b199-3221-4c7b-a78f-bc5754f32230 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:05.621153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:05.621863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:05.622215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:05.622550 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:05.648236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:05.650374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:05.661508 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1183/2369] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:07.015013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:07.015571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:07.015571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:07.035929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] MFA Rules not processed for user `6226d826c5f64cbe84a617eb1686f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:07.037194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:07.045185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1187/2370] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:13.767571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:13.778329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba58d-92c2-4ec7-ab7e-48d0b6ebf271 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:13.782737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:13.783344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:13.783637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:13.783890 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:13.785785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:13.798854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:13.800125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:13.812080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1184/2371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:17.030438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:17.328753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:17.330600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:17.346354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96e8a-ddbf-46ba-8772-dfcb1f7f46c1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:17.351978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:17.352705 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:17.352976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:17.353475 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] PATH_INFO: `/v3/users/a9f13d57ca4a40f6811758eb5103c8e2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:17.354707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f13d57ca4a40f6811758eb5103c8e2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:17.357127 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:17.406247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f13d57ca4a40f6811758eb5103c8e2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.406921 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f13d57ca4a40f6811758eb5103c8e2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.415532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f13d57ca4a40f6811758eb5103c8e2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.428236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f13d57ca4a40f6811758eb5103c8e2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.435076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-45f32e2a-f4e1-4498-b9de-3604d180fd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f13d57ca4a40f6811758eb5103c8e2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.440970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1188/2372] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:17 2022] DELETE /identity/v3/users/a9f13d57ca4a40f6811758eb5103c8e2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:17.690120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:17.700643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55737e-56e4-4852-8a86-dc97cc63c0b5 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:17.760429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:17.761098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:17.761375 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:17.761644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] PATH_INFO: `/v3/projects/672db51cc9e8452ea83616390536514b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:17.762785 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672db51cc9e8452ea83616390536514b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:17.764675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:17.813312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672db51cc9e8452ea83616390536514b', 'request_id': 'req-a1485230-ba6d-475c-8801-a92099e63b47'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.823509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672db51cc9e8452ea83616390536514b', 'request_id': 'req-a1485230-ba6d-475c-8801-a92099e63b47'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.829692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672db51cc9e8452ea83616390536514b', 'request_id': 'req-a1485230-ba6d-475c-8801-a92099e63b47'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.841861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] The token cache is being invalidate because project 672db51cc9e8452ea83616390536514b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:17.842142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.842780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a1485230-ba6d-475c-8801-a92099e63b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:17.844305 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1185/2373] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:17 2022] DELETE /identity/v3/projects/672db51cc9e8452ea83616390536514b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:17.855137 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:17.855417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:17.855685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:17.876368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:17.877591 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:17.938063 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1189/2374] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:17.946753 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:17.947064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:17.947371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:17.967579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:17.968791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:17.977327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1186/2375] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:17.981673 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:17.991624 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10a006-dff1-4a8e-ade3-e776fd4055f5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:17.996932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:17.997560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:17.997834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:17.998099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:17.998746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:17.999045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.000642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.012272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1190/2376] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:18.016444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.025673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630201cb-75f0-4cf5-8636-649536dbabb4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.030492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.031088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.031365 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.031634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.032259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.034204 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.038986 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:18.065434 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1187/2377] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:18 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:18.071388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.082043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d9d5-81bc-42d9-86de-c665030026ee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.140642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.141305 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.141580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.141842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.142480 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.144471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.152723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:18.173161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1191/2378] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:18 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:51:18.174363 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.184978 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6da4a8-b6d9-4070-8707-04b6e4ab9401 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.190993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.191968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.192240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.192503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.193191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.194789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.204958 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1188/2379] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:18.209218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.219491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731863-8115-4450-8244-25946aa191b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.224587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.225226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.225500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.225774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.226418 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.227996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff221ba6-c288-40fe-8b20-da2ac94783fa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.239270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1192/2380] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:18.243601 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.253799 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fc3-9770-4304-9f61-68fd861dbf35 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.259492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.260157 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.260429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.260683 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] PATH_INFO: `/v3/projects/88019cd7eba34e3386a7c51aae6951a4/users/060dfe757dcb4585979806abc4c37faa/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.275898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88019cd7eba34e3386a7c51aae6951a4, user_id=060dfe757dcb4585979806abc4c37faa, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.278557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.292477 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1189/2381] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:18 2022] PUT /identity/v3/projects/88019cd7eba34e3386a7c51aae6951a4/users/060dfe757dcb4585979806abc4c37faa/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:51:18.302910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.303187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.303454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.332552 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] MFA Rules not processed for user `060dfe757dcb4585979806abc4c37faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:18.333533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:18.400927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1193/2382] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:18.414035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.416106 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:18.497956 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a923b-2978-424b-84b8-d3581eacad99 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.503849 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.504469 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.504745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.505036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.513025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.514612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e252c8-7ed8-4ee2-a710-d879877244c1 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.523949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1190/2383] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:18.773565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:18.840382 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc218cc-140f-4932-91ae-366186b8c40d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:18.845560 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:18.846226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.846701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.846925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] PATH_INFO: `/v3/users/060dfe757dcb4585979806abc4c37faa` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.847932 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060dfe757dcb4585979806abc4c37faa)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:18.850000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:18.898341 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060dfe757dcb4585979806abc4c37faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:18.898989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060dfe757dcb4585979806abc4c37faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:18.906584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060dfe757dcb4585979806abc4c37faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:18.917596 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:18.918991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060dfe757dcb4585979806abc4c37faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:18.928606 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060dfe757dcb4585979806abc4c37faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:18.934812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1194/2384] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:18 2022] DELETE /identity/v3/users/060dfe757dcb4585979806abc4c37faa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:18.939400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:18.939905 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:18.940001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:18.960385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:18.961650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:19.020876 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1191/2385] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:19.031396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.033875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:19.100555 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420c0a9-8312-4a3d-9a5f-2fb017f6bc06 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.104495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.105101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.105402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.105672 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.115290 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.116724 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305937a-a27b-4a02-9ff3-db3c05f5d42b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.126307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1195/2386] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:19.394261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.395755 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:19.408558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182b0ee-0783-4b00-a899-a428dc867f9a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.414455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.415104 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.415380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.415673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] PATH_INFO: `/v3/projects/88019cd7eba34e3386a7c51aae6951a4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.416921 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88019cd7eba34e3386a7c51aae6951a4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.418883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.468778 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:19.484528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88019cd7eba34e3386a7c51aae6951a4', 'request_id': 'req-9f71db2e-36a9-4134-a16a-58276a828ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:19.493151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88019cd7eba34e3386a7c51aae6951a4', 'request_id': 'req-9f71db2e-36a9-4134-a16a-58276a828ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:19.498725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88019cd7eba34e3386a7c51aae6951a4', 'request_id': 'req-9f71db2e-36a9-4134-a16a-58276a828ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:19.510000 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] The token cache is being invalidate because project 88019cd7eba34e3386a7c51aae6951a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:19.510289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:19.510988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f71db2e-36a9-4134-a16a-58276a828ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:19.512598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1192/2387] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:19 2022] DELETE /identity/v3/projects/88019cd7eba34e3386a7c51aae6951a4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:51:19.517717 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.518001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.518270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.538428 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:19.539637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:19.601719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1196/2388] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:19.611425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.611703 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.611979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.632298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:19.633515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:19.642142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1193/2389] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:19.647182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.662402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7097d9-b08a-4a34-a786-243661a2105d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.671057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.671920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.672303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.672671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.673646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:19.674076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.676239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.688318 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1197/2390] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:19.693088 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.702852 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00056-5fc9-4011-9a37-344bc414305a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.708492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.709107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.709387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.709649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.710304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.712355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.741843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1194/2391] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:19 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:19.746527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.756884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae6878-3522-43f1-8e00-2dcb75eb7a55 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.814172 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.814791 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.815047 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.815310 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.815963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.818249 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.841446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1198/2392] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:19 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:19.845723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.856475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a9a34-ac08-4d52-b142-fb6d806730a0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.861806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.862394 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.862743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.863035 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.863659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.865314 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.875720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1195/2393] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:51:19.879854 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.890092 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a6af-64a6-47cc-82e5-b6592c38cd1d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.895181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.895711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.895985 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.896254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.896892 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.898539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1f0ac-f2d1-4b5e-be23-e2e56a3f068a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.899848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:19.910894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1199/2394] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:19.915018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:19.925129 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e77a-afbe-4f0b-957d-acb6e9bb6e7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:19.930067 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:19.930717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.930996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.931252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] PATH_INFO: `/v3/projects/77880cad57d047618405f71e5b014097/users/7a257f7a30b34d19b64ecfdf33f73f91/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:19.948084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=77880cad57d047618405f71e5b014097, user_id=7a257f7a30b34d19b64ecfdf33f73f91, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:19.950231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:19.964399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1196/2395] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:19 2022] PUT /identity/v3/projects/77880cad57d047618405f71e5b014097/users/7a257f7a30b34d19b64ecfdf33f73f91/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:19.974899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:19.975243 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:19.975581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.003406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] MFA Rules not processed for user `7a257f7a30b34d19b64ecfdf33f73f91`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:20.004696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:20.071651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1200/2396] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:20.076353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.139114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022fd8-3118-4ef1-b096-9c0154c2f1cf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.145030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.145744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.145918 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.146205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.146857 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.148825 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.182384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1197/2397] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:20.187760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.201223 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306b3ed-8adc-4bd8-9af1-b70b8b3820d7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.259144 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.259756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.260048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.260315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.260940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.262923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.285532 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1201/2398] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:20 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:20.289883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.300137 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23329c51-252e-41b4-9394-0b63c5ea1795 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.304788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.305415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.305689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.305955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.306570 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.308151 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.319234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1198/2399] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:20.325509 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.337758 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482815-5e31-4b63-ab9a-592c10473497 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.343117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.343773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.344069 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.344324 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] PATH_INFO: `/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7/users/2eaeda05eb34427f9431d269018fb3e2/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.360349 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1f1543e2dc4c00a2b7d09fa3ce1ee7, user_id=2eaeda05eb34427f9431d269018fb3e2, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.363104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.377195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1202/2400] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:20 2022] PUT /identity/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7/users/2eaeda05eb34427f9431d269018fb3e2/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:20.381177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.391152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7934b-b1fc-4998-92db-11f47e589094 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.417845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:20.451211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.451832 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.452107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.452381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.453038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.454637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4650f2b-1d16-4230-a7f7-e70c2f00b99a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.464350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1199/2401] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:51:20.468691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.479470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff485db-6b5c-489e-81be-5a4470104c03 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.484641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.485336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.485653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.485919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] PATH_INFO: `/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7/users/2eaeda05eb34427f9431d269018fb3e2/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.488197 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1f1543e2dc4c00a2b7d09fa3ce1ee7, user_id=2eaeda05eb34427f9431d269018fb3e2, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.490930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.501766 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1203/2402] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:20 2022] PUT /identity/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7/users/2eaeda05eb34427f9431d269018fb3e2/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:20.512065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.512356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.512647 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.544015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] MFA Rules not processed for user `2eaeda05eb34427f9431d269018fb3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:20.545354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:20.621811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1200/2403] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:20.633539 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:20.635307 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:20.680761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:20.717831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b055f-8edb-457a-b2d7-e0503e6342d3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:20.722110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:20.722730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:20.723033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:20.723299 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:20.733666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:20.735116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c8c0-12b3-4e3f-b291-c9c82710bf97 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:20.745331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1204/2404] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:21.158125 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:21.221722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d516e-13a7-465d-b443-4674c00b7bb3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:21.226215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:21.226840 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:21.227148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:21.227387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] PATH_INFO: `/v3/users/7a257f7a30b34d19b64ecfdf33f73f91` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:21.228523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a257f7a30b34d19b64ecfdf33f73f91)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:21.230450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:21.280573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a257f7a30b34d19b64ecfdf33f73f91'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.284197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:21.290814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a257f7a30b34d19b64ecfdf33f73f91'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.305428 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a257f7a30b34d19b64ecfdf33f73f91'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.306100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a257f7a30b34d19b64ecfdf33f73f91'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.318675 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a257f7a30b34d19b64ecfdf33f73f91'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.324584 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1201/2405] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:21 2022] DELETE /identity/v3/users/7a257f7a30b34d19b64ecfdf33f73f91 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:21.329140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:21.329619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:21.329619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:21.349219 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:21.350438 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:21.415337 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1205/2406] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:21.425374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:21.427042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:21.490266 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a963a9-6a0c-4e31-914d-852fc5560b3b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:21.493726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:21.494330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:21.494599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:21.494861 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:21.503831 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:21.505396 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:21.514962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1202/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:21.791540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:21.793195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:21.806168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9816a7-3d75-450c-8959-a67f5219d4f1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:21.812676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:21.813546 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:21.813820 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:21.814236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] PATH_INFO: `/v3/projects/77880cad57d047618405f71e5b014097` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:21.815420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77880cad57d047618405f71e5b014097)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:21.818019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:21.866198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77880cad57d047618405f71e5b014097', 'request_id': 'req-0069ce91-b923-401c-b8ca-711b0fc35a9d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.875296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77880cad57d047618405f71e5b014097', 'request_id': 'req-0069ce91-b923-401c-b8ca-711b0fc35a9d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.881078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77880cad57d047618405f71e5b014097', 'request_id': 'req-0069ce91-b923-401c-b8ca-711b0fc35a9d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.892368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] The token cache is being invalidate because project 77880cad57d047618405f71e5b014097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:21.892647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.893303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:21.894881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1206/2408] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:21 2022] DELETE /identity/v3/projects/77880cad57d047618405f71e5b014097 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:21.899082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:21.909195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5b473-a042-4d2d-bb32-f2e880080565 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:21.971055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:21.971697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:21.971975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:21.972246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] PATH_INFO: `/v3/users/2eaeda05eb34427f9431d269018fb3e2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:21.973573 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaeda05eb34427f9431d269018fb3e2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:21.975497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.024947 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaeda05eb34427f9431d269018fb3e2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.032609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaeda05eb34427f9431d269018fb3e2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.044884 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaeda05eb34427f9431d269018fb3e2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.045497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaeda05eb34427f9431d269018fb3e2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.048977 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:22.056101 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2f6336db-46cc-40b8-b194-76bab4054c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaeda05eb34427f9431d269018fb3e2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.063650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1203/2409] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:21 2022] DELETE /identity/v3/users/2eaeda05eb34427f9431d269018fb3e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:22.395421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.397211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:22.411118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ce91-b923-401c-b8ca-711b0fc35a9d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.458980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:22.478863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.479510 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.479782 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.480052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] PATH_INFO: `/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.481252 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1f1543e2dc4c00a2b7d09fa3ce1ee7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.483175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.542218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1f1543e2dc4c00a2b7d09fa3ce1ee7', 'request_id': 'req-4a416d15-fb83-4680-b15e-8a404660503c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.552039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1f1543e2dc4c00a2b7d09fa3ce1ee7', 'request_id': 'req-4a416d15-fb83-4680-b15e-8a404660503c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.558490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1f1543e2dc4c00a2b7d09fa3ce1ee7', 'request_id': 'req-4a416d15-fb83-4680-b15e-8a404660503c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.575401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] The token cache is being invalidate because project ca1f1543e2dc4c00a2b7d09fa3ce1ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:22.575691 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.576483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a416d15-fb83-4680-b15e-8a404660503c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:22.581798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1207/2410] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:22 2022] DELETE /identity/v3/projects/ca1f1543e2dc4c00a2b7d09fa3ce1ee7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:22.583380 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.583834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.583955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.603885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:22.605145 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:22.677250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1204/2411] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:22.681676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.682094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.682371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.703250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:22.704486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:22.713236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1208/2412] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:22.717695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.727467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471651-f771-4ee2-a057-2a3a8a336771 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.732020 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.732638 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.732914 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.733219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.733877 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:22.734180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.736012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.749551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1205/2413] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:22.754211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.765026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cd397-610d-4e0a-a48f-0999e566c9fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.770078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.770696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.770970 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.771239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.771888 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.773864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.812783 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1209/2414] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:22 2022] POST /identity/v3/projects => generated 355 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:51:22.814047 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.824745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fe373-3338-45f1-a454-59c8203f1133 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.888213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.889077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.889223 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.889395 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.890027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.891999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.916444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1206/2415] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:22 2022] POST /identity/v3/users => generated 278 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:22.920819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.931207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72c87-0bfb-494c-86b7-731f61258801 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.936902 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.937649 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.937928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.938250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.938904 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.940817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.953761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1210/2416] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:51:22.957429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:22.967811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd922ff-e6b2-4c3a-bdbe-22c4e2e23db5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:22.972624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:22.973262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:22.973533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:22.973805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:22.974438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:22.976056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1caf1c-75c4-49f9-8952-c04c07edae31 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:22.987122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1207/2417] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:22.991260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.001495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b56c1-e5ea-4084-8fdb-e98040bec780 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.006753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.007417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.007693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.007965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] PATH_INFO: `/v3/projects/130853076efb42f1b55d0b083e9320a6/users/4f921e4f970a43438cb4fd0a993acd15/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.023610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130853076efb42f1b55d0b083e9320a6, user_id=4f921e4f970a43438cb4fd0a993acd15, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.026303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.040711 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1211/2418] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:22 2022] PUT /identity/v3/projects/130853076efb42f1b55d0b083e9320a6/users/4f921e4f970a43438cb4fd0a993acd15/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:23.051519 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.051805 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.052076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.083568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] MFA Rules not processed for user `4f921e4f970a43438cb4fd0a993acd15`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:23.084903 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:23.133374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:23.155251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1208/2419] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:23.160040 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.223647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c097a-1086-4231-96ba-686bc9f6ef72 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.228767 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.229429 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.229708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.229977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.230626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.232573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.248401 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:23.269350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1212/2420] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:23 2022] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:23.270605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.282323 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13ea7-cbf5-49a8-b248-9310a48f47f0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.344624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.344624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.344624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.344624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.345093 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.347017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.376098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1209/2421] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:23 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:23.377431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.388976 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9824eb-e0e1-4506-add8-f3fb2f50a2f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.394057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.394716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.394971 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.395280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.395914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.397597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.409279 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1213/2422] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:23.413729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.424379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5d2b-0b6f-4ce3-9713-69a85271e8e5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.429503 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.430189 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.430465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.430730 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] PATH_INFO: `/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699/users/4a50b4d1c5d04cdbac545feedcb2f78e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.448855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184d51d7c8ec477aa11ab4b8b0e13699, user_id=4a50b4d1c5d04cdbac545feedcb2f78e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.452181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.469855 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1210/2423] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:23 2022] PUT /identity/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699/users/4a50b4d1c5d04cdbac545feedcb2f78e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:23.473816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.484048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea0e70-f88a-4ab2-b5b6-2b41164117a3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.541643 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.542257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.542530 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.542799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.543441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.545067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20701419-772d-4e2e-8d1f-3f62ea41f8cd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.555146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1214/2424] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:23.559374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.571663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be913cd-8cab-4c43-8e87-2ca1c61b6e95 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.582333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.583029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.583302 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.583569 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] PATH_INFO: `/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699/users/4a50b4d1c5d04cdbac545feedcb2f78e/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.585636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] RBAC: Authorizing `identity:create_grant(project_id=184d51d7c8ec477aa11ab4b8b0e13699, user_id=4a50b4d1c5d04cdbac545feedcb2f78e, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.588333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.599255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1211/2425] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:23 2022] PUT /identity/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699/users/4a50b4d1c5d04cdbac545feedcb2f78e/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:23.610689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.610973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.611246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.640568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] MFA Rules not processed for user `4a50b4d1c5d04cdbac545feedcb2f78e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:23.641843 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:23.712465 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1215/2426] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:23.724207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.726509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:23.784867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d30b-4aab-482a-bf0a-ba5a3ff8242e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.788901 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.789529 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.789801 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.790066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.799468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.800911 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.813605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1212/2427] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:23.896873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:23.906811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97d09-4c65-4ca8-ae39-84e9871ed781 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:23.910777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:23.911420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:23.911687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:23.911965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:23.970583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:23.972130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2351a8-a49a-4613-8ef3-70c1bac9ec7b service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:23.980944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1216/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:33.806234 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:33.977133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:39.072416 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:39.136722 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d970a7-3ab8-4fa2-bfac-7e4a021c9ac9 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:39.142325 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:39.142959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:39.143241 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:39.143499 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] PATH_INFO: `/v3/users/4f921e4f970a43438cb4fd0a993acd15` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:39.144767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f921e4f970a43438cb4fd0a993acd15)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:39.146720 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:39.206252 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f921e4f970a43438cb4fd0a993acd15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.215148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f921e4f970a43438cb4fd0a993acd15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.227180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f921e4f970a43438cb4fd0a993acd15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.227817 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f921e4f970a43438cb4fd0a993acd15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.235055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f921e4f970a43438cb4fd0a993acd15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.241389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1213/2429] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:39 2022] DELETE /identity/v3/users/4f921e4f970a43438cb4fd0a993acd15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:39.246351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:39.246865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:39.246865 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:39.266473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:39.267662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:39.329180 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1217/2430] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:39.339304 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:39.340900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:39.401736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d1e3-a232-403b-9ed8-33c33dde74e2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:39.405782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:39.406384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:39.406663 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:39.406933 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:39.416649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:39.418121 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:39.428371 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1214/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:39.706692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:39.708373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:39.720631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ddcb0-d7f3-4263-a84e-5f6f823952da None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:39.725362 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:39.725989 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:39.726263 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:39.726533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] PATH_INFO: `/v3/projects/130853076efb42f1b55d0b083e9320a6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:39.727642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] RBAC: Authorizing `identity:delete_project(project_id=130853076efb42f1b55d0b083e9320a6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:39.729615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:39.778388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130853076efb42f1b55d0b083e9320a6', 'request_id': 'req-42f02eab-197b-4f2b-9621-12adbbf8949d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.786655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130853076efb42f1b55d0b083e9320a6', 'request_id': 'req-42f02eab-197b-4f2b-9621-12adbbf8949d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.792316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130853076efb42f1b55d0b083e9320a6', 'request_id': 'req-42f02eab-197b-4f2b-9621-12adbbf8949d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.803694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] The token cache is being invalidate because project 130853076efb42f1b55d0b083e9320a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:39.803978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.804612 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.806090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1218/2432] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:39 2022] DELETE /identity/v3/projects/130853076efb42f1b55d0b083e9320a6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:39.810279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:39.820423 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd1d45-f73e-4d42-b375-7e7009e3b76a service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:39.839557 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:39.883217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:39.883843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:39.884111 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:39.884377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] PATH_INFO: `/v3/users/4a50b4d1c5d04cdbac545feedcb2f78e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:39.885627 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a50b4d1c5d04cdbac545feedcb2f78e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:39.887533 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:39.935743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a50b4d1c5d04cdbac545feedcb2f78e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.945202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a50b4d1c5d04cdbac545feedcb2f78e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.956812 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a50b4d1c5d04cdbac545feedcb2f78e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.957364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a50b4d1c5d04cdbac545feedcb2f78e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.964092 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-965a6ac8-c6ef-4782-a8ac-7913feb712e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a50b4d1c5d04cdbac545feedcb2f78e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:39.969821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1215/2433] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:39 2022] DELETE /identity/v3/users/4a50b4d1c5d04cdbac545feedcb2f78e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:51:40.254485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.256005 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:40.269832 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02eab-197b-4f2b-9621-12adbbf8949d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.330359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.330993 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.331266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.331562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] PATH_INFO: `/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.332725 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184d51d7c8ec477aa11ab4b8b0e13699)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.334694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.365829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:40.383145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184d51d7c8ec477aa11ab4b8b0e13699', 'request_id': 'req-6a9e0047-db95-44d4-9710-cedb607f1ce0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:40.390916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184d51d7c8ec477aa11ab4b8b0e13699', 'request_id': 'req-6a9e0047-db95-44d4-9710-cedb607f1ce0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:40.396597 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184d51d7c8ec477aa11ab4b8b0e13699', 'request_id': 'req-6a9e0047-db95-44d4-9710-cedb607f1ce0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:40.407812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] The token cache is being invalidate because project 184d51d7c8ec477aa11ab4b8b0e13699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:40.408099 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:40.408829 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6a9e0047-db95-44d4-9710-cedb607f1ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:40.410426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1219/2434] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:40 2022] DELETE /identity/v3/projects/184d51d7c8ec477aa11ab4b8b0e13699 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:40.415452 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.415962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.416079 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.437172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:40.438620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:40.500868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1216/2435] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:40.508729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589378-65e5-4c34-9901-ec8251031aea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.509023 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589378-65e5-4c34-9901-ec8251031aea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.509312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589378-65e5-4c34-9901-ec8251031aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.529217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-52589378-65e5-4c34-9901-ec8251031aea None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:40.530417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-52589378-65e5-4c34-9901-ec8251031aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:40.542444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1220/2436] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:40.546993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.558985 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810686-8370-4b95-9c61-6ce308bcb131 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.566995 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.567608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.567878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.568141 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.568797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:40.569694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.570711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.582866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1217/2437] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:40.587688 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589378-65e5-4c34-9901-ec8251031aea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.597364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589378-65e5-4c34-9901-ec8251031aea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.603298 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.603894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.604160 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.604421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.605062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.606960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.636473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1221/2438] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:40.640823 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.650979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae5605-13db-4719-8c80-3fa0a3b0f6bc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.677818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:40.709919 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.710513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.710782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.711046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.711658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.713687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.735475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1218/2439] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:40.739651 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.750681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262b67-0f5c-4a23-96e8-a7d0888b251a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.755756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.756281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.756551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.756819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.757491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.759082 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.769608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1222/2440] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:40.774001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.789439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97eb1-a3ad-47be-bd11-216c8c95e61d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.795388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.795987 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.796259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.796525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.797224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.798818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c0ea6-207a-4bad-9e6b-b0b41771ca26 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.809842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1219/2441] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:40.814141 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:40.824617 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196daf3-7d26-4608-a48c-8c8a5ea9f0b4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:40.829520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:40.830162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.830430 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.830701 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] PATH_INFO: `/v3/projects/d82cac4f4bba4564a8328582e26e8c22/users/f56202b7d9e64d0bb48aa7b2cadec0b8/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.845658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82cac4f4bba4564a8328582e26e8c22, user_id=f56202b7d9e64d0bb48aa7b2cadec0b8, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:40.848348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:40.863802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1223/2442] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:40 2022] PUT /identity/v3/projects/d82cac4f4bba4564a8328582e26e8c22/users/f56202b7d9e64d0bb48aa7b2cadec0b8/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:51:40.875420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:40.875696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:40.875959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:40.904419 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] MFA Rules not processed for user `f56202b7d9e64d0bb48aa7b2cadec0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:40.905685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:40.970414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1220/2443] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:40.975067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.037121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08480-2c49-4cf0-a963-9fcd28e428d5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.042314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.042912 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.043188 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.043426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.044071 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.046031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.075771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1224/2444] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:40 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:41.080296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.091170 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f3e04-a6af-4642-b7fd-a91657a1794f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.147553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.148259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.148531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.148791 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.149450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.151507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.177068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1221/2445] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:41 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:41.181814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.192516 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a54c0-bee0-4972-bb82-a941198ae383 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.197434 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.198037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.198303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.198568 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.199208 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.200800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.212610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1225/2446] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:41.217351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.232031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715721-bd07-4c27-93b5-5a96e1026702 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.237436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.238084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.238359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.238633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] PATH_INFO: `/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea/users/5627bd701b0941718d96a50a3e5f4f3a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.253939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1580ff3dafcb4a669b8fcb899c5bebea, user_id=5627bd701b0941718d96a50a3e5f4f3a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.256679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.272500 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1222/2447] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:41 2022] PUT /identity/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea/users/5627bd701b0941718d96a50a3e5f4f3a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:41.277822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.288028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd1f11-ca35-4efc-9870-0ad53a1882ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.309409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:41.347905 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.348506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.348773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.349054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.349692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.351268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e6447-7efb-456c-9285-a6e661dddc4c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.361601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1226/2448] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:51:41.367207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.372928 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:41.380358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804c65-6ce0-4f60-a9bd-6a643ac3b0c0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.385815 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.386455 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.386739 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.387006 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] PATH_INFO: `/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea/users/5627bd701b0941718d96a50a3e5f4f3a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.389043 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1580ff3dafcb4a669b8fcb899c5bebea, user_id=5627bd701b0941718d96a50a3e5f4f3a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.391655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.402613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1223/2449] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:41 2022] PUT /identity/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea/users/5627bd701b0941718d96a50a3e5f4f3a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:41.413033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.413326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.413609 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.444139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] MFA Rules not processed for user `5627bd701b0941718d96a50a3e5f4f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:41.445405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:41.516381 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1227/2450] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:41.528610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.531633 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:41.597408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d831c-51fc-482d-a012-a44012436cd0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.601447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.602055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.602327 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.602561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.611797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.613277 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.622689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1224/2451] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:41.707018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:41.716875 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4bbc-83e8-40e2-bf41-ed50e7059300 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:41.721386 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:41.721990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:41.722264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:41.722528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:41.781474 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:41.782909 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c94ec1-75cd-463e-a00d-b02eb801df6e service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:41.792218 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1228/2452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:48.954246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:49.025677 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f703-b7ac-4e22-be35-0fa455ab8b72 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:49.030515 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:49.031142 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:49.031408 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:49.031669 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] PATH_INFO: `/v3/users/f56202b7d9e64d0bb48aa7b2cadec0b8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:49.032808 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56202b7d9e64d0bb48aa7b2cadec0b8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:49.034728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:49.087492 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56202b7d9e64d0bb48aa7b2cadec0b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.095822 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56202b7d9e64d0bb48aa7b2cadec0b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.108639 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56202b7d9e64d0bb48aa7b2cadec0b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.109374 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56202b7d9e64d0bb48aa7b2cadec0b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.116641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56202b7d9e64d0bb48aa7b2cadec0b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.122600 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1225/2453] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:48 2022] DELETE /identity/v3/users/f56202b7d9e64d0bb48aa7b2cadec0b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:49.127100 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:49.127589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:49.127695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:49.146917 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:49.148124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:49.197994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:49.217792 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1229/2454] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:49.227939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:49.229542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:49.244068 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:49.289247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b2684-f610-4647-987a-ec317e9fcf84 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:49.293201 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:49.293811 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:49.294090 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:49.294351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:49.303881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:49.305333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:49.314964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1226/2455] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:49.609166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:49.610730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:49.623473 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55ad90-aa6a-45e6-88bd-e183c31636b3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:49.629234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:49.629881 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:49.630139 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:49.630411 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] PATH_INFO: `/v3/projects/d82cac4f4bba4564a8328582e26e8c22` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:49.631641 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82cac4f4bba4564a8328582e26e8c22)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:49.633707 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:49.683816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82cac4f4bba4564a8328582e26e8c22', 'request_id': 'req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.693268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82cac4f4bba4564a8328582e26e8c22', 'request_id': 'req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.698882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82cac4f4bba4564a8328582e26e8c22', 'request_id': 'req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.709802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] The token cache is being invalidate because project d82cac4f4bba4564a8328582e26e8c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:49.710087 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.710723 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.712210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1230/2456] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:49 2022] DELETE /identity/v3/projects/d82cac4f4bba4564a8328582e26e8c22 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:49.716331 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:49.726347 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbd81-687f-4abd-bf61-d74c169c1156 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:49.785238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:49.785889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:49.786161 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:49.786551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] PATH_INFO: `/v3/users/5627bd701b0941718d96a50a3e5f4f3a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:49.787728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5627bd701b0941718d96a50a3e5f4f3a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:49.789679 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:49.840521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5627bd701b0941718d96a50a3e5f4f3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.850881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5627bd701b0941718d96a50a3e5f4f3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.865398 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5627bd701b0941718d96a50a3e5f4f3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.866149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5627bd701b0941718d96a50a3e5f4f3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.873691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-337bf784-d033-4e09-8c7e-6b3a0ffcd46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5627bd701b0941718d96a50a3e5f4f3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:49.879993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1227/2457] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:49 2022] DELETE /identity/v3/users/5627bd701b0941718d96a50a3e5f4f3a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:50.159920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.161490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:50.175919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217cf7-05af-4e3e-b3ba-2f5cbaa421c9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.248285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.248940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.249242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.249505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] PATH_INFO: `/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.250668 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1580ff3dafcb4a669b8fcb899c5bebea)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.252599 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.304946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1580ff3dafcb4a669b8fcb899c5bebea', 'request_id': 'req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:50.314125 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1580ff3dafcb4a669b8fcb899c5bebea', 'request_id': 'req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:50.320753 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1580ff3dafcb4a669b8fcb899c5bebea', 'request_id': 'req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:50.327845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:50.332529 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] The token cache is being invalidate because project 1580ff3dafcb4a669b8fcb899c5bebea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:50.333296 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:50.334049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d5336be2-7cd1-40a5-9aa1-cf704a41f0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:50.335553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1231/2458] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:50 2022] DELETE /identity/v3/projects/1580ff3dafcb4a669b8fcb899c5bebea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:50.343436 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.343916 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.344031 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.365425 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:50.366640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:50.396009 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:50.429797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1228/2459] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:50.438284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.438575 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.438844 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.467140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:50.468884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:50.479885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1232/2460] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:50.484714 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.494724 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02268a-3bdc-4a05-b424-113d9025bea2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.500448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.501033 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.501342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.501603 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.502238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:51:50.502602 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.504187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.516278 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1229/2461] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:51:50.520626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.530260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82cba-b66d-4556-b2f6-434118490742 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.536164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.536756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.537039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.537316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.537937 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.539834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.571453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1233/2462] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:51:50 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:50.575821 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.585717 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629d13-b494-40a6-bad7-89009df135f8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.641838 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.642440 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.642723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.642981 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.643620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.645667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.668930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1230/2463] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:51:50 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:51:50.674537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.685507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846da82-a4bf-4608-b9e5-a1cca7c21b56 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.692109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.692901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.693221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.693483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.694118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.695709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.705750 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1234/2464] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:50.709797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.720112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8b3bf-827c-4fbb-b6bd-6b2f63e40cc8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.725162 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.725756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.726032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.726300 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.726939 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.728525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5766-f71f-4c11-89d9-9c5c82e9ca7a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.739521 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1231/2465] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:51:50.743441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.753676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd7c2e-f607-400d-97f8-1db8011f5289 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.758786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.759446 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.759690 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.759955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] PATH_INFO: `/v3/projects/a2bc837f43e140639a5698cde956c670/users/f51187cc98104f6da2f82cee941eacd1/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.774765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bc837f43e140639a5698cde956c670, user_id=f51187cc98104f6da2f82cee941eacd1, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:50.777409 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:50.792415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1235/2466] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:51:50 2022] PUT /identity/v3/projects/a2bc837f43e140639a5698cde956c670/users/f51187cc98104f6da2f82cee941eacd1/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:50.803867 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.804167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.804451 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:50.833236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] MFA Rules not processed for user `f51187cc98104f6da2f82cee941eacd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:50.834497 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:50.916697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1232/2467] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:50.928389 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:50.930481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:50.988826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dc62d-b77a-470c-aa10-066103d9147c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:50.993458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:50.994037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:50.994354 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:50.994608 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:51.003326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:51.004796 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae33d6-2dde-4697-97b1-21a013a823d8 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:51.013772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1236/2468] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:51.040338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:51.073507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:51.106389 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd42f2-770b-4ddc-b970-6d09e909a3ec None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:51.111387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:51.112017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:51.112294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:51.112596 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] PATH_INFO: `/v3/users/f51187cc98104f6da2f82cee941eacd1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:51.113797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51187cc98104f6da2f82cee941eacd1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:51.115715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:51.165640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51187cc98104f6da2f82cee941eacd1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.175274 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51187cc98104f6da2f82cee941eacd1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.188072 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51187cc98104f6da2f82cee941eacd1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.188797 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51187cc98104f6da2f82cee941eacd1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.196296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51187cc98104f6da2f82cee941eacd1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.202120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1233/2469] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:51:51 2022] DELETE /identity/v3/users/f51187cc98104f6da2f82cee941eacd1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:51:51.206768 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:51.207295 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:51.207392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:51.227153 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:51:51.228345 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:51.289476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1237/2470] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:51:51.299510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:51.301245 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:51.361385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae0b8-f2d3-476e-b1b0-3c410c233bd0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:51.366051 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:51.366715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:51.366991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:51.367257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:51.377130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:51.378563 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:51.388530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1234/2471] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:51:51.730866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:51.732417 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:51.744814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91462c-bbb1-4e0b-8f2d-1dc8f807287e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:51.751379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:51.751935 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:51.752207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:51.752470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] PATH_INFO: `/v3/projects/a2bc837f43e140639a5698cde956c670` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:51.754415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bc837f43e140639a5698cde956c670)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:51.756376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:51.795496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:51.809744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bc837f43e140639a5698cde956c670', 'request_id': 'req-79cde37c-4a45-4509-a263-effae94936d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.818207 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bc837f43e140639a5698cde956c670', 'request_id': 'req-79cde37c-4a45-4509-a263-effae94936d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.823944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bc837f43e140639a5698cde956c670', 'request_id': 'req-79cde37c-4a45-4509-a263-effae94936d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.835184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] The token cache is being invalidate because project a2bc837f43e140639a5698cde956c670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:51:51.835464 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.836162 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:51:51.837795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1238/2472] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:51:51 2022] DELETE /identity/v3/projects/a2bc837f43e140639a5698cde956c670 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:51:59.778646 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:51:59.780150 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:59.793100 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb87d6c-4559-4e7f-a33f-63b650eddb07 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:51:59.848070 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:51:59.849037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:51:59.849307 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:51:59.849625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:51:59.851634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:51:59.857642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:51:59.925774 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:51:59.927215 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25371-3a35-4e47-a50a-904031195ad0 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:51:59.938505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1235/2473] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:51:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:52:01.832230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:09.933599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=31 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:38.938289 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:52:38.939800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:38.998780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cde37c-4a45-4509-a263-effae94936d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:52:39.003001 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:52:39.003598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:52:39.003878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:52:39.004140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:52:39.006089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:39.019319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:52:39.020738 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:52:39.031489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1239/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:52:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:52:42.813773 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:52:42.814352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:52:42.814352 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:52:42.835644 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] MFA Rules not processed for user `6226d826c5f64cbe84a617eb1686f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:52:42.836885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:42.891738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1236/2475] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:52:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:52:43.536078 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:52:43.537570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:43.610150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd031b-fe70-44cb-854d-ff057fc626f2 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:52:43.615300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:52:43.615903 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:52:43.616173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:52:43.616433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:52:43.618210 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:43.629181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:52:43.630746 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:52:43.640889 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1240/2476] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:52:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:52:45.668810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:52:45.670450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:45.683354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278663-c707-494b-8abf-7539ee5be8bd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:52:45.687178 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:52:45.687794 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:52:45.688062 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:52:45.688324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:52:45.690510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:45.700869 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:52:45.702404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:52:45.713379 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1237/2477] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:52:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:52:46.686400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:52:46.687955 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:46.704495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71857cbb-a146-4e6d-a76d-3e2cb255a065 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:52:46.711363 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:52:46.712102 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:52:46.712508 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:52:46.712868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:52:46.714837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:52:46.727926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:52:46.729601 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:52:46.741847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1241/2478] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:52:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:52:55.707467 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=31 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:52:56.737615 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=64 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:53:51.026386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:53:51.029163 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:51.044581 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901dd77-33e3-489b-a38b-3e73a7f395bf service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:53:51.048810 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:53:51.049443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:53:51.049711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:53:51.049971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:53:51.052045 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:51.113255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:53:51.114859 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:53:51.124066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1238/2479] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:53:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:53:51.980653 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:53:51.983220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:52.000886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c5e3-8465-42a1-9acb-9b6be49f5d98 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:53:52.007415 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:53:52.008272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:53:52.008655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:53:52.008990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:53:52.010895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:52.024700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:53:52.026748 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:53:52.038650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1242/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:53:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:53:55.847687 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:53:55.857182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789583-7654-43cd-86d8-ec04760ef177 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:53:55.861040 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:53:55.861645 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:53:55.861920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:53:55.862186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:53:55.864037 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:55.927159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:53:55.928583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:53:55.938620 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1239/2481] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:53:59.051000 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:53:59.063785 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe68ae6-4a2f-4e87-8a27-4358e6c0cdbc service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:53:59.070154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:53:59.070886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:53:59.071185 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:53:59.071450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:53:59.073359 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:53:59.086737 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:53:59.088504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:53:59.099562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1243/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:53:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:54:02.249099 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:02.250593 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:02.265845 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008e394-5f10-41cd-914a-520baa31e28d service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:02.270474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:02.271086 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:02.271357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:02.271619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] PATH_INFO: `/v3/users/55df78a792e7485180f39ff2f10cf06c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:02.272715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55df78a792e7485180f39ff2f10cf06c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:02.274657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:02.324354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55df78a792e7485180f39ff2f10cf06c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.333359 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55df78a792e7485180f39ff2f10cf06c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.345571 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55df78a792e7485180f39ff2f10cf06c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.346213 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55df78a792e7485180f39ff2f10cf06c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.353758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55df78a792e7485180f39ff2f10cf06c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.360279 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1240/2483] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:54:02 2022] DELETE /identity/v3/users/55df78a792e7485180f39ff2f10cf06c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:54:02.541557 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:02.554390 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba577e1a-dec6-483e-adee-199b9c877a5c service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:02.625372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:02.625998 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:02.626268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:02.626540 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] PATH_INFO: `/v3/projects/080df92f9cec459c98cd7d337ce0eac4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:02.627650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080df92f9cec459c98cd7d337ce0eac4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:02.629576 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:02.682581 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080df92f9cec459c98cd7d337ce0eac4', 'request_id': 'req-ce785f10-ee3e-4ac9-9a06-861b52103ba3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.689309 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080df92f9cec459c98cd7d337ce0eac4', 'request_id': 'req-ce785f10-ee3e-4ac9-9a06-861b52103ba3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.695165 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080df92f9cec459c98cd7d337ce0eac4', 'request_id': 'req-ce785f10-ee3e-4ac9-9a06-861b52103ba3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.706090 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] The token cache is being invalidate because project 080df92f9cec459c98cd7d337ce0eac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:54:02.706370 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.707043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.708648 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1244/2484] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:54:02 2022] DELETE /identity/v3/projects/080df92f9cec459c98cd7d337ce0eac4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:54:02.712880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:02.714404 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:02.724439 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:02.728547 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cb8f6-96b0-45bd-914d-eb69556d201f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:02.788329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:02.788972 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:02.789254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:02.789524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] PATH_INFO: `/v3/users/02be4f770823430ba8b6b560e92b11c3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:02.790691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02be4f770823430ba8b6b560e92b11c3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:02.792594 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:02.840348 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02be4f770823430ba8b6b560e92b11c3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.849105 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02be4f770823430ba8b6b560e92b11c3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.862118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02be4f770823430ba8b6b560e92b11c3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.862776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02be4f770823430ba8b6b560e92b11c3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.870617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ed6a9efe-ccd2-4079-a23b-7588a276cec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02be4f770823430ba8b6b560e92b11c3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:02.876672 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1241/2485] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:54:02 2022] DELETE /identity/v3/users/02be4f770823430ba8b6b560e92b11c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:54:03.050110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:03.051562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:03.072700 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce785f10-ee3e-4ac9-9a06-861b52103ba3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:03.130794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:03.131425 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:03.131708 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:03.131954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] PATH_INFO: `/v3/projects/724b3b947fdc4ace8c389aeb25c61847` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:03.133129 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724b3b947fdc4ace8c389aeb25c61847)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:03.135048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:03.141339 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:03.183676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724b3b947fdc4ace8c389aeb25c61847', 'request_id': 'req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:03.192052 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724b3b947fdc4ace8c389aeb25c61847', 'request_id': 'req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:03.197992 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724b3b947fdc4ace8c389aeb25c61847', 'request_id': 'req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:03.209378 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] The token cache is being invalidate because project 724b3b947fdc4ace8c389aeb25c61847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:54:03.209658 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:03.210334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:54:03.211864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1245/2486] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:54:03 2022] DELETE /identity/v3/projects/724b3b947fdc4ace8c389aeb25c61847 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:54:12.873402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:13.206670 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:26.792511 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:26.793071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:26.793071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:26.813112 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] MFA Rules not processed for user `6226d826c5f64cbe84a617eb1686f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:54:26.814334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:26.872950 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1242/2487] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:54:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:54:27.199616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:27.201383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:27.263664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b1f-fdbc-423c-bb7b-467c22f4ad97 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:27.267784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:27.268433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:27.268704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:27.268967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:27.271148 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:27.281184 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:27.282610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:27.290797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1246/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:54:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:54:35.297790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:54:35.299553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:35.375172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ea57-baa0-44d5-8f45-0ce1e40736c1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:54:35.381350 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:54:35.381963 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:54:35.382230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:54:35.382493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:54:35.384247 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:54:35.396413 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:54:35.398002 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3f71-81ad-499c-8b84-0545c0ae0842 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:54:35.408680 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1243/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:54:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:54:37.287426 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=26 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:54:45.404402 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=59 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:18.931348 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:55:18.933124 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:55:19.015598 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50abb19-636b-4ee9-87b2-56bd9289cd3c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:55:19.021226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:55:19.021827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:55:19.022101 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:55:19.022364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:55:19.024224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:55:19.036566 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:55:19.038240 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:55:19.048633 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1247/2490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:55:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:55:29.044266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=32 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:55:56.515826 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:55:56.516364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:55:56.516364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:55:56.535862 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] MFA Rules not processed for user `6226d826c5f64cbe84a617eb1686f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:55:56.537205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:55:56.544202 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1244/2491] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:56:05.433287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:56:05.434801 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:56:05.447355 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8d9b-924d-4343-a43b-21ad67470bd1 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:56:05.451506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:56:05.452110 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:56:05.452373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:56:05.452638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:56:05.454696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:56:05.466018 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:56:05.467439 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:56:05.476118 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1248/2492] 10.222.0.30 () {60 vars in 1396 bytes} [Tue Oct 11 06:56:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:56:06.530708 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:56:15.472187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:16.563691 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:16.565483 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:16.625299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b23f9-31b1-4f1f-ba7f-035957e9ca8c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:16.629283 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:16.629893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:16.630168 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:16.630435 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:16.632172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:16.646752 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:16.648154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:16.659175 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1245/2493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:26.654292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=26 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:29.780267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:29.789729 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3149f-151c-44e2-85cb-16df83debc3e service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:29.793910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:29.794511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:29.794786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:29.795054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:29.796952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:29.864471 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:29.865948 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:29.877495 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1249/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:33.051764 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.053299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:33.067930 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934744-454d-4b25-917a-f547acbd55f0 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.072649 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.073355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.073697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.074032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] PATH_INFO: `/v3/users/6226d826c5f64cbe84a617eb1686f4ea` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.075231 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6226d826c5f64cbe84a617eb1686f4ea)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.077249 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.129032 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6226d826c5f64cbe84a617eb1686f4ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.137513 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6226d826c5f64cbe84a617eb1686f4ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.151276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6226d826c5f64cbe84a617eb1686f4ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.151929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6226d826c5f64cbe84a617eb1686f4ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.160505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7bc5579c-91ef-4f56-91b4-789b9e990a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6226d826c5f64cbe84a617eb1686f4ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.169626 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1246/2495] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:33 2022] DELETE /identity/v3/users/6226d826c5f64cbe84a617eb1686f4ea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:33.351400 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.361848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d9c3c-2e4e-4174-b46c-1726577f92ac service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.420074 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.420706 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.420965 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.421264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] PATH_INFO: `/v3/projects/0267c1e10ce04b078ecb8d83ad530a9b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.422466 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0267c1e10ce04b078ecb8d83ad530a9b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.424364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.471850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0267c1e10ce04b078ecb8d83ad530a9b', 'request_id': 'req-1c11faef-b7e1-4b07-9702-0e858f2537c4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.480250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0267c1e10ce04b078ecb8d83ad530a9b', 'request_id': 'req-1c11faef-b7e1-4b07-9702-0e858f2537c4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.486091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0267c1e10ce04b078ecb8d83ad530a9b', 'request_id': 'req-1c11faef-b7e1-4b07-9702-0e858f2537c4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.497685 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] The token cache is being invalidate because project 0267c1e10ce04b078ecb8d83ad530a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:33.497847 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.498565 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1c11faef-b7e1-4b07-9702-0e858f2537c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:33.500798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1250/2496] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:33 2022] DELETE /identity/v3/projects/0267c1e10ce04b078ecb8d83ad530a9b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:33.506076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.506361 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.506605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.527758 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:33.528988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:33.598595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1247/2497] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:33.607369 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.607646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.607913 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.628470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:33.629716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:33.637943 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1251/2498] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:33.642387 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.652535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cece75-9260-45a7-8c8f-c88b4f0ad3a4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.658207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.658847 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.659120 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.659388 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.660069 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:57:33.660368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.662010 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.673961 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1248/2499] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:57:33.678422 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.687853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13120ff6-1881-4486-94c8-a4aca6b7f150 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.692942 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.693562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.693834 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.694095 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.694716 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.696589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.711800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:33.736094 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1252/2500] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:33 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:33.740415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.750615 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76cb63-a64b-4791-b12d-90bb0bb8c00e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.807545 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.808147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.808426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.808694 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.809343 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.811262 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.820024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:33.835693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1249/2501] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:33 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:33.839755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.851200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9a20-13f9-427b-aee8-042b92fb27ac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.856533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.857230 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.857494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.857756 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.858399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.859954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.870257 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1253/2502] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:33.874426 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.884803 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb6b71-6002-4eb5-a8b5-2436f0a85680 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.889828 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.890420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.890695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.890959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.891595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.893288 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc5f3-422e-43f0-8411-9609e3858a06 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.904049 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1250/2503] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:33.908414 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:33.918827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8f6f8-6b49-4de7-b57c-ee35c1b16ca8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:33.924457 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:33.925133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.925387 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.925674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] PATH_INFO: `/v3/projects/737c0fd054fc46879a5a6d036b1b078e/users/95aad959b13d4f859d275ea71dc595e0/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:33.940610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737c0fd054fc46879a5a6d036b1b078e, user_id=95aad959b13d4f859d275ea71dc595e0, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:33.943613 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:33.959536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1254/2504] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:33 2022] PUT /identity/v3/projects/737c0fd054fc46879a5a6d036b1b078e/users/95aad959b13d4f859d275ea71dc595e0/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:33.969998 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:33.970280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:33.971134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.011880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] MFA Rules not processed for user `95aad959b13d4f859d275ea71dc595e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:34.013870 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:34.082296 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1251/2505] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:34.087012 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.152367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22369db-2cce-49b0-92df-f0bde3fc2290 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.165800 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.166416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.166694 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.166967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.167692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.169745 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.203058 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1255/2506] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:34 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:34.208540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.219608 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8b1b-a201-4cbf-8b7b-2a0693f3088e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.275542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.276140 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.276414 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.276681 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.277334 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.279209 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.308902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1252/2507] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:34 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:34.313336 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.326805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764228b-4074-46a0-951a-1df4f2a7f3be admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.332842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.333614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.333873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.334201 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.335115 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.337771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.355769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1256/2508] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:34.360628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.372078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5b7e3-99e7-4dd3-b2de-efc0bf5029d8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.378256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.378944 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.379251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.379473 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] PATH_INFO: `/v3/projects/40da837a8b0b4192962659ac1ae4252d/users/73874dc2e904405ea7aaed525b9bf941/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.396507 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40da837a8b0b4192962659ac1ae4252d, user_id=73874dc2e904405ea7aaed525b9bf941, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.399692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.417527 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1253/2509] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:34 2022] PUT /identity/v3/projects/40da837a8b0b4192962659ac1ae4252d/users/73874dc2e904405ea7aaed525b9bf941/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:34.423350 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.440806 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ab1da-b3f0-4109-8ecf-a8722473cf72 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.507679 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.508286 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.508558 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.508822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.509483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.511109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296bf42-3771-4392-9026-03a25637ec60 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.521742 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1257/2510] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:34.527723 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.540464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370bb15-9f91-4069-ae49-9f512465dc95 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.546411 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.547071 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.547344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.547611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] PATH_INFO: `/v3/projects/40da837a8b0b4192962659ac1ae4252d/users/73874dc2e904405ea7aaed525b9bf941/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.549880 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40da837a8b0b4192962659ac1ae4252d, user_id=73874dc2e904405ea7aaed525b9bf941, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.552526 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.566146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1254/2511] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:34 2022] PUT /identity/v3/projects/40da837a8b0b4192962659ac1ae4252d/users/73874dc2e904405ea7aaed525b9bf941/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:34.577784 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.578066 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.578326 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.609956 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] MFA Rules not processed for user `73874dc2e904405ea7aaed525b9bf941`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:34.611319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:34.621696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:34.689512 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1258/2512] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:34.706883 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:34.709117 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:34.736399 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:34.772980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b8558-12d7-43ac-8017-e65ca3494d29 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:34.776830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:34.777456 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:34.777725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:34.777988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:34.787546 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:34.788971 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921f64a-68a9-49c9-a682-a0f2831e878b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:34.798298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1255/2513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:35.249699 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:35.311627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58c665-369c-4765-bb0d-35f392fcd09d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:35.316644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:35.317637 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:35.317901 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:35.318167 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] PATH_INFO: `/v3/users/95aad959b13d4f859d275ea71dc595e0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:35.319283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95aad959b13d4f859d275ea71dc595e0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:35.321229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:35.366831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95aad959b13d4f859d275ea71dc595e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.367485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95aad959b13d4f859d275ea71dc595e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.375674 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95aad959b13d4f859d275ea71dc595e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.387857 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95aad959b13d4f859d275ea71dc595e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.395088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95aad959b13d4f859d275ea71dc595e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.402062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1259/2514] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:35 2022] DELETE /identity/v3/users/95aad959b13d4f859d275ea71dc595e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:35.406871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:35.407344 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:35.407442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:35.427149 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:35.428355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:35.492029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1256/2515] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:35.502421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:35.503947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:35.534664 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:35.565128 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26282498-6232-4a12-a476-e4bd328f7f9e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:35.569283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:35.569890 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:35.570164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:35.570424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:35.579780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:35.581236 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:35.590528 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1260/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:35.862725 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:35.864254 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:35.882113 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a76ee2-6e76-425a-bcba-ff10f839dfae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:35.888198 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:35.888830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:35.889236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:35.889401 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] PATH_INFO: `/v3/projects/737c0fd054fc46879a5a6d036b1b078e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:35.890616 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737c0fd054fc46879a5a6d036b1b078e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:35.892530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:35.943143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737c0fd054fc46879a5a6d036b1b078e', 'request_id': 'req-5a358db0-78ab-41d8-b0a7-913aac1500c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.952879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737c0fd054fc46879a5a6d036b1b078e', 'request_id': 'req-5a358db0-78ab-41d8-b0a7-913aac1500c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.958738 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737c0fd054fc46879a5a6d036b1b078e', 'request_id': 'req-5a358db0-78ab-41d8-b0a7-913aac1500c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.969990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] The token cache is being invalidate because project 737c0fd054fc46879a5a6d036b1b078e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:35.971474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.971474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:35.973036 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1257/2517] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:35 2022] DELETE /identity/v3/projects/737c0fd054fc46879a5a6d036b1b078e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:35.977220 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:35.988377 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1af8b2-b1c3-4b16-a8e3-233e0c8e8cf9 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.050686 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.051234 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.051500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.051765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] PATH_INFO: `/v3/users/73874dc2e904405ea7aaed525b9bf941` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.052940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73874dc2e904405ea7aaed525b9bf941)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.054880 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.105242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73874dc2e904405ea7aaed525b9bf941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.105878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73874dc2e904405ea7aaed525b9bf941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.114780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73874dc2e904405ea7aaed525b9bf941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.127584 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73874dc2e904405ea7aaed525b9bf941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.134496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-24e218f8-4fac-42f4-ae33-71e74c33ccf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73874dc2e904405ea7aaed525b9bf941'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.140616 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1261/2518] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:35 2022] DELETE /identity/v3/users/73874dc2e904405ea7aaed525b9bf941 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:36.425893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.427418 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:36.444324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a358db0-78ab-41d8-b0a7-913aac1500c6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.489239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:36.503599 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.504239 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.504510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.504776 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] PATH_INFO: `/v3/projects/40da837a8b0b4192962659ac1ae4252d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.505974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40da837a8b0b4192962659ac1ae4252d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.507853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.562362 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40da837a8b0b4192962659ac1ae4252d', 'request_id': 'req-663fd653-3d91-459d-9a23-d1e753f746c1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.572118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40da837a8b0b4192962659ac1ae4252d', 'request_id': 'req-663fd653-3d91-459d-9a23-d1e753f746c1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.578585 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40da837a8b0b4192962659ac1ae4252d', 'request_id': 'req-663fd653-3d91-459d-9a23-d1e753f746c1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.591261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] The token cache is being invalidate because project 40da837a8b0b4192962659ac1ae4252d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:36.591657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.592422 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-663fd653-3d91-459d-9a23-d1e753f746c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:36.594236 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1258/2519] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:36 2022] DELETE /identity/v3/projects/40da837a8b0b4192962659ac1ae4252d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:36.599268 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.599826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.599826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.619610 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:36.620823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:36.663245 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:36.679300 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1262/2520] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:36.692007 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.692636 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.692906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.713270 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:36.714465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:36.723012 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1259/2521] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:36.727543 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.737790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fd15f-5b13-49da-93c9-82115d29c93a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.742818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.743419 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.743687 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.743954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.744629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:57:36.744925 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.746549 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.758454 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1263/2522] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:57:36.762619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.771902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194dea9-612a-462b-ba6c-6333ff21a3e4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.777044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.777634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.777902 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.778169 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.778782 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.780654 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.810754 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1260/2523] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:36 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:36.815068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.826469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1102a-9096-428a-91d7-4afd47abc159 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.883978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.884583 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.884855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.885154 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.885777 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.887714 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.910460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1264/2524] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:36 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:36.914692 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.925299 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d45f-6a48-4d1b-99ca-497b77b74888 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.930289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.930886 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.931164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.931433 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.932077 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.934370 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.945878 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1261/2525] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:36.949923 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.960416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b52697-f4e8-45a3-93d7-4ee35e27a09e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:36.966402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:36.967045 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:36.967334 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:36.967603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:36.968265 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:36.969846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538598ad-b691-4665-a664-57fe4bf6045b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:36.979967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1265/2526] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:36.984087 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:36.994814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b85c-fe4f-48ac-9d6d-3a170cb2566c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.000727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.001415 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.001701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.001968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] PATH_INFO: `/v3/projects/ad8a711cd6d34e1d96e7b6ea3f51cfe9/users/547f2a1c4e6e42cb92b42c8624202ade/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.017463 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8a711cd6d34e1d96e7b6ea3f51cfe9, user_id=547f2a1c4e6e42cb92b42c8624202ade, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.020144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.035155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1262/2527] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:36 2022] PUT /identity/v3/projects/ad8a711cd6d34e1d96e7b6ea3f51cfe9/users/547f2a1c4e6e42cb92b42c8624202ade/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:37.046406 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.046765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.047117 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.076914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] MFA Rules not processed for user `547f2a1c4e6e42cb92b42c8624202ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:37.078067 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:37.146294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1266/2528] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:37.152621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.220030 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4da5-283d-4840-adf6-32dce8d6d06c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.225355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.226084 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.226355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.226617 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.227260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.229184 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.252345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:37.259989 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1263/2529] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:37 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:37.264146 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.274819 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2626882-99ad-4d65-ba55-d4078831205f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.319364 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:37.339089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.339620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.339893 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.340147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.340793 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.342744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.365815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1267/2530] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:37 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:37.369888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.380205 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1a74d-0c7f-42d5-a3ec-81b22d9a6f83 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.384848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.385505 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.385767 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.386019 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.386653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.388230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.398655 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1264/2531] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:37.402842 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.413178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058118d3-b24d-44b0-9782-9defec59873d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.418031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.418668 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.418940 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.419200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] PATH_INFO: `/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a/users/2e521f38d7e84168b85bbfb4a4112d03/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.434273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f963f34dde3f4b3083861f8d2ec0ed6a, user_id=2e521f38d7e84168b85bbfb4a4112d03, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.436972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.452022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1268/2532] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:37 2022] PUT /identity/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a/users/2e521f38d7e84168b85bbfb4a4112d03/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:57:37.455990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.466522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038191e-7c8e-4a2a-bdee-ec4426c8c70d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.523085 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.523686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.523965 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.524253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.524874 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.526480 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda54dc-afe5-4b33-a0cf-b18755afdffd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.536196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1265/2533] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:37.541774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.552719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26e92-a162-4402-a3f0-15b0e8ba3741 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.557828 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.558481 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.558749 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.559015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] PATH_INFO: `/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a/users/2e521f38d7e84168b85bbfb4a4112d03/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.561483 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f963f34dde3f4b3083861f8d2ec0ed6a, user_id=2e521f38d7e84168b85bbfb4a4112d03, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.564267 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.575817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1269/2534] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:37 2022] PUT /identity/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a/users/2e521f38d7e84168b85bbfb4a4112d03/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:57:37.643686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.643969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.644207 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.684185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] MFA Rules not processed for user `2e521f38d7e84168b85bbfb4a4112d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:37.685444 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:37.757955 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1266/2535] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:37.769181 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:37.771353 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:37.833780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5406441-c37c-4b38-bcd2-8c1c2f8cb1cc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:37.837833 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:37.838427 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:37.838702 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:37.838973 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:37.848313 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:37.849774 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2480d-d057-412b-aa50-2ab914dd9efc service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:37.859200 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1270/2536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:38.013937 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:38.082256 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc99fc-7d05-4370-9664-5f1e79bdff8f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:38.088060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:38.088696 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:38.088969 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:38.089280 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] PATH_INFO: `/v3/users/547f2a1c4e6e42cb92b42c8624202ade` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:38.090518 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=547f2a1c4e6e42cb92b42c8624202ade)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:38.092453 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:38.103471 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:38.146377 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547f2a1c4e6e42cb92b42c8624202ade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.154650 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547f2a1c4e6e42cb92b42c8624202ade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.167871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547f2a1c4e6e42cb92b42c8624202ade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.168548 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547f2a1c4e6e42cb92b42c8624202ade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.175674 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547f2a1c4e6e42cb92b42c8624202ade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.181863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1267/2537] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:38 2022] DELETE /identity/v3/users/547f2a1c4e6e42cb92b42c8624202ade => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:38.186592 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:38.186876 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:38.187150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:38.207652 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:38.208868 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:38.271284 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1271/2538] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:38.283729 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:38.285400 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:38.344737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9865861-995c-45f5-aec9-eed250a7a62f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:38.349114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:38.349715 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:38.349996 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:38.350260 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:38.359814 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:38.361259 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:38.371052 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1268/2539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:38.659822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:38.661467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:38.675327 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5345-ae99-4051-9b62-3f2b43efdc3a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:38.680947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:38.681773 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:38.682054 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:38.682328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] PATH_INFO: `/v3/projects/ad8a711cd6d34e1d96e7b6ea3f51cfe9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:38.683569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8a711cd6d34e1d96e7b6ea3f51cfe9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:38.685520 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:38.724786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:38.736399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8a711cd6d34e1d96e7b6ea3f51cfe9', 'request_id': 'req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.744398 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8a711cd6d34e1d96e7b6ea3f51cfe9', 'request_id': 'req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.750551 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8a711cd6d34e1d96e7b6ea3f51cfe9', 'request_id': 'req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.762145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] The token cache is being invalidate because project ad8a711cd6d34e1d96e7b6ea3f51cfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:38.762433 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.763161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.765049 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1272/2540] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:38 2022] DELETE /identity/v3/projects/ad8a711cd6d34e1d96e7b6ea3f51cfe9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:38.769384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:38.779159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52ebc6-b360-4fe4-8cb3-0e3bb627ac36 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:38.836097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:38.836728 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:38.837021 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:38.837292 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] PATH_INFO: `/v3/users/2e521f38d7e84168b85bbfb4a4112d03` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:38.838528 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e521f38d7e84168b85bbfb4a4112d03)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:38.840437 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:38.876872 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:38.891165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e521f38d7e84168b85bbfb4a4112d03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.899261 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e521f38d7e84168b85bbfb4a4112d03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.911018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e521f38d7e84168b85bbfb4a4112d03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.911727 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e521f38d7e84168b85bbfb4a4112d03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.919351 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-93007898-5e4d-472d-8a86-9ce89e6c8fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e521f38d7e84168b85bbfb4a4112d03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:38.925609 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1269/2541] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:38 2022] DELETE /identity/v3/users/2e521f38d7e84168b85bbfb4a4112d03 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:39.198915 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.200954 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:39.216397 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1693b0-ce9e-423f-8757-f2b1c50c14d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.273150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.273751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.274019 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.274283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] PATH_INFO: `/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.275408 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f963f34dde3f4b3083861f8d2ec0ed6a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.277347 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.329827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f963f34dde3f4b3083861f8d2ec0ed6a', 'request_id': 'req-2f97e92a-784c-4493-8600-958000fef2a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:39.338919 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f963f34dde3f4b3083861f8d2ec0ed6a', 'request_id': 'req-2f97e92a-784c-4493-8600-958000fef2a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:39.344373 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f963f34dde3f4b3083861f8d2ec0ed6a', 'request_id': 'req-2f97e92a-784c-4493-8600-958000fef2a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:39.355256 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] The token cache is being invalidate because project f963f34dde3f4b3083861f8d2ec0ed6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:39.355536 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:39.356168 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f97e92a-784c-4493-8600-958000fef2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:39.357693 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1273/2542] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:39 2022] DELETE /identity/v3/projects/f963f34dde3f4b3083861f8d2ec0ed6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:39.363097 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.363373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.363641 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.383583 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:39.384772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:39.451001 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1270/2543] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:39.459735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.460030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.460320 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.483769 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:39.484972 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:39.494420 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1274/2544] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:39.498736 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.509095 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914612-c079-4800-99bc-ab3cbe3f16ac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.514653 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.515255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.515532 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.515806 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.516448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:57:39.516745 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.518366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.530303 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1271/2545] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:57:39.534500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.544062 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6e531-bd98-4ea2-83d3-15807e6a22a6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.549741 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.550330 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.550600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.550863 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.551494 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.553450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.584371 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1275/2546] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:39.589217 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.599741 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dc056-b1f4-414b-b520-bb40279c2c2f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.661354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.661983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.662258 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.662542 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.663154 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.665064 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.687524 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1272/2547] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:39.691960 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.702805 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be32df-3f9d-4272-baa7-658910acb730 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.708109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.708710 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.708980 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.709272 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.709907 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.711499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.722026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1276/2548] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:39.725941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.736228 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c5b3-3c45-4268-bec6-9fb54cce5593 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.741509 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.742107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.742381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.742634 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.743273 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.744893 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569a16-4afc-449d-be1e-8f229226574d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.755678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1273/2549] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:39.760025 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.770470 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e4a4-f02f-4742-9ed0-dcfba4ac10a1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.775603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.776235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.776506 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.776770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] PATH_INFO: `/v3/projects/95e841b7deff4c83b21ce8d2293f9c0e/users/37c2524fee734b55bb228ebe14df35ec/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.788790 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:39.793254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e841b7deff4c83b21ce8d2293f9c0e, user_id=37c2524fee734b55bb228ebe14df35ec, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:39.795885 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:39.810089 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1277/2550] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:39 2022] PUT /identity/v3/projects/95e841b7deff4c83b21ce8d2293f9c0e/users/37c2524fee734b55bb228ebe14df35ec/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:39.820598 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.821114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.821238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.850412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] MFA Rules not processed for user `37c2524fee734b55bb228ebe14df35ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:39.851637 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:39.856026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:39.921386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1274/2551] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:39.926031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:39.988285 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92190730-e58e-41db-bb51-0922c282b085 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:39.996814 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:39.997467 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:39.997744 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:39.998007 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:39.998669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.000803 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.034011 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1278/2552] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:40.038251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.048929 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4312db-e1b0-46cf-a6ec-0fcb9dc4c5ca None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.104448 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.105080 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.105357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.105622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.106251 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.108152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.130879 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1275/2553] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:40 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:40.135013 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.145759 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8988-5a1c-44e6-8387-7df288e13ca2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.151280 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.151886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.152161 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.152437 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.153116 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.154735 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.165837 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1279/2554] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:40.169820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.180015 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfeb00-f974-4d83-bb26-b9da4842fb38 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.184760 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.185386 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.185659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.185925 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.186560 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.188133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846524d1-5605-412f-a2fd-abb87c9c29bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.198589 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1276/2555] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:57:40.202627 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.215226 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6925e2-242c-476d-b0cf-03d97283d765 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.220521 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.221312 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.221680 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.222111 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] PATH_INFO: `/v3/projects/8b70d971dd1147038c7239b295a1e030/users/35f593f5fda2412e9b909c62159ee3f9/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.237198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b70d971dd1147038c7239b295a1e030, user_id=35f593f5fda2412e9b909c62159ee3f9, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.239878 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.254405 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1280/2556] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:40 2022] PUT /identity/v3/projects/8b70d971dd1147038c7239b295a1e030/users/35f593f5fda2412e9b909c62159ee3f9/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:40.271450 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.271747 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.272005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.301310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] MFA Rules not processed for user `35f593f5fda2412e9b909c62159ee3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:40.302410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:40.367026 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1277/2557] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:40.371676 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.440332 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8c007-5dca-4818-b103-ac85606592c5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.445928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.446537 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.446817 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.447091 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.447728 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.449695 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.478260 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1281/2558] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:40 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:40.482662 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.494107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16b546-790c-4091-9fd2-2c2874ab19ae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.503959 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:40.552707 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.553264 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.553540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.553807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.554429 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.556330 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.579484 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1278/2559] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:40 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:40.583671 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.594022 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d25615-a139-47bb-b2ae-e7bc6ea08b72 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.598853 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.599453 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.599726 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.599994 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.600632 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.602261 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.612786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1282/2560] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:57:40.617133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.627643 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d87-4541-448a-9b14-87a69f7b4856 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.633027 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.633693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.633964 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.634238 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] PATH_INFO: `/v3/projects/951016439ce5460194f272fe76cc4ba8/users/fc27a1b66130440f911a55f4f6078877/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.649993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] RBAC: Authorizing `identity:create_grant(project_id=951016439ce5460194f272fe76cc4ba8, user_id=fc27a1b66130440f911a55f4f6078877, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.652737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.667678 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1279/2561] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:40 2022] PUT /identity/v3/projects/951016439ce5460194f272fe76cc4ba8/users/fc27a1b66130440f911a55f4f6078877/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:40.671772 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.682264 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06086f-a4a3-46c6-b994-f780c063fc67 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.693770 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:40.742043 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.742644 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.742914 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.743179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.743831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.745460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704156f0-3ce1-4072-a4ba-985152612294 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.755463 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1283/2562] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:40.760003 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.770800 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65dab7-8c79-4f2d-83cd-00f8fc71117e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.776212 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.776851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.777180 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.777443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] PATH_INFO: `/v3/projects/951016439ce5460194f272fe76cc4ba8/users/fc27a1b66130440f911a55f4f6078877/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.779625 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=951016439ce5460194f272fe76cc4ba8, user_id=fc27a1b66130440f911a55f4f6078877, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.782276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:40.793366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1280/2563] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:40 2022] PUT /identity/v3/projects/951016439ce5460194f272fe76cc4ba8/users/fc27a1b66130440f911a55f4f6078877/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:40.803779 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.803952 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.804242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.833736 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] MFA Rules not processed for user `fc27a1b66130440f911a55f4f6078877`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:40.834950 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:40.908795 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1284/2564] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:40.920613 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:40.922540 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:40.981267 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d48-2682-47be-a016-e6b950030aec admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:40.985275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:40.985875 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:40.986147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:40.986410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:40.995909 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:40.997356 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:41.006701 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1281/2565] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:41.049383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:41.050762 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:41.062967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcc457-b78a-42fd-a332-83215323cf68 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:41.066871 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:41.067900 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:41.068179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:41.068442 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:41.125331 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:41.126754 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67f0a2-5295-4c15-8670-59699aba15d7 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:41.135831 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1285/2566] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:44.074226 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:44.137920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae46c6d-edce-4634-b0b3-497efb9f6753 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:44.143153 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:44.143783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:44.144060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:44.144329 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] PATH_INFO: `/v3/users/37c2524fee734b55bb228ebe14df35ec` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:44.145624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c2524fee734b55bb228ebe14df35ec)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:44.147551 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:44.158265 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:44.197054 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c2524fee734b55bb228ebe14df35ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.205605 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c2524fee734b55bb228ebe14df35ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.218294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c2524fee734b55bb228ebe14df35ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.218999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c2524fee734b55bb228ebe14df35ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.226114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c2524fee734b55bb228ebe14df35ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.231941 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1282/2567] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:44 2022] DELETE /identity/v3/users/37c2524fee734b55bb228ebe14df35ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:44.236550 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:44.237061 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:44.237192 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:44.257216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:44.258396 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:44.289015 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:44.320884 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1286/2568] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:44.331034 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:44.332517 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:44.390834 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3e2ac-abee-4794-beac-f4d64bf43cdb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:44.395065 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:44.395689 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:44.395966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:44.396227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:44.407658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:44.409848 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:44.419983 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1283/2569] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:44.702629 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:44.704076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:44.717273 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8ab41-1064-4ed5-858f-6aa566e2d6a5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:44.722096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:44.722730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:44.723008 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:44.723271 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] PATH_INFO: `/v3/projects/95e841b7deff4c83b21ce8d2293f9c0e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:44.724469 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e841b7deff4c83b21ce8d2293f9c0e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:44.726458 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:44.776864 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e841b7deff4c83b21ce8d2293f9c0e', 'request_id': 'req-edb59e9d-5d79-4079-9c61-b066b145465f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.784421 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e841b7deff4c83b21ce8d2293f9c0e', 'request_id': 'req-edb59e9d-5d79-4079-9c61-b066b145465f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.790106 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e841b7deff4c83b21ce8d2293f9c0e', 'request_id': 'req-edb59e9d-5d79-4079-9c61-b066b145465f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.801030 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] The token cache is being invalidate because project 95e841b7deff4c83b21ce8d2293f9c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:44.801391 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.802037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.803571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1287/2570] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:44 2022] DELETE /identity/v3/projects/95e841b7deff4c83b21ce8d2293f9c0e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:44.809211 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:44.821686 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bfa7b-af44-4c10-9bbc-3f68637453a1 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:44.884253 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:44.884907 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:44.885224 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:44.885462 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] PATH_INFO: `/v3/users/35f593f5fda2412e9b909c62159ee3f9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:44.886595 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f593f5fda2412e9b909c62159ee3f9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:44.888535 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:44.925622 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:44.944008 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f593f5fda2412e9b909c62159ee3f9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.956174 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f593f5fda2412e9b909c62159ee3f9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.969197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f593f5fda2412e9b909c62159ee3f9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.969868 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f593f5fda2412e9b909c62159ee3f9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.976830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f593f5fda2412e9b909c62159ee3f9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:44.982756 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1284/2571] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:44 2022] DELETE /identity/v3/users/35f593f5fda2412e9b909c62159ee3f9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:45.261786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:45.263303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:45.276957 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59e9d-5d79-4079-9c61-b066b145465f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:45.337946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:45.338504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:45.338802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:45.339068 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] PATH_INFO: `/v3/projects/8b70d971dd1147038c7239b295a1e030` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:45.340246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b70d971dd1147038c7239b295a1e030)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:45.342198 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:45.391436 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b70d971dd1147038c7239b295a1e030', 'request_id': 'req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.400235 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b70d971dd1147038c7239b295a1e030', 'request_id': 'req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.402486 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:45.407182 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b70d971dd1147038c7239b295a1e030', 'request_id': 'req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.418799 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] The token cache is being invalidate because project 8b70d971dd1147038c7239b295a1e030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:45.419077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.419722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.421221 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1288/2572] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:45 2022] DELETE /identity/v3/projects/8b70d971dd1147038c7239b295a1e030 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:45.425240 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:45.426704 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:45.439461 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79036da-d768-4dc9-9b89-260089c6e184 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:45.494673 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:45.495297 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:45.495562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:45.495844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] PATH_INFO: `/v3/users/fc27a1b66130440f911a55f4f6078877` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:45.497152 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc27a1b66130440f911a55f4f6078877)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:45.498920 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:45.547850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc27a1b66130440f911a55f4f6078877'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.557227 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc27a1b66130440f911a55f4f6078877'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.570024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc27a1b66130440f911a55f4f6078877'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.570709 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc27a1b66130440f911a55f4f6078877'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.577768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7f00b88c-0522-44cf-a3ff-b62b23bdec11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc27a1b66130440f911a55f4f6078877'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.584018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1285/2573] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:45 2022] DELETE /identity/v3/users/fc27a1b66130440f911a55f4f6078877 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:45.855070 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:45.856515 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:45.871472 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af137b6-8ffc-4ef8-887b-d1a82a2dd7e0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:45.929816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:45.930447 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:45.930715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:45.930982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] PATH_INFO: `/v3/projects/951016439ce5460194f272fe76cc4ba8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:45.932150 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951016439ce5460194f272fe76cc4ba8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:45.934085 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:45.982351 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951016439ce5460194f272fe76cc4ba8', 'request_id': 'req-063fbbd5-d0e2-437a-93f7-6b472fa380a4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.990544 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951016439ce5460194f272fe76cc4ba8', 'request_id': 'req-063fbbd5-d0e2-437a-93f7-6b472fa380a4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:45.996224 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951016439ce5460194f272fe76cc4ba8', 'request_id': 'req-063fbbd5-d0e2-437a-93f7-6b472fa380a4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:46.007248 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] The token cache is being invalidate because project 951016439ce5460194f272fe76cc4ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:46.007527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:46.008179 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-063fbbd5-d0e2-437a-93f7-6b472fa380a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:46.009730 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1289/2574] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:45 2022] DELETE /identity/v3/projects/951016439ce5460194f272fe76cc4ba8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:46.017494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.018737 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.019018 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.045763 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:46.046974 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:46.077130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:46.114181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1286/2575] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 06:57:46.122431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.122715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.122987 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.143372 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:46.144619 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:46.152928 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1290/2576] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:46.157220 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.167016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4be380-1197-472b-9e73-5c492bd58d1e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.172014 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.172610 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.172882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.173187 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.173830 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:57:46.174146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.175771 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.187491 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1287/2577] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:57:46.192242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.203826 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9172f5-3541-46a8-8c48-a2ec057af973 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.209852 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.210452 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.210848 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.211121 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.211812 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.213763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.242856 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1291/2578] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:46.247130 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.257342 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4efe6c-1a5d-4ae3-a8b8-31b6f31e28fe admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.314768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.315368 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.315657 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.315906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.316531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.318888 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.341863 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1288/2579] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:46.346206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.356491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f6e71-98dd-4dbd-a6cd-6caa77286b07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.361600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.362229 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.362496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.362761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.363388 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.365145 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.374951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1292/2580] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:57:46.378900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.389357 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc215f5-93d1-496f-a59c-2972e9d662a8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.394196 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.394783 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.395055 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.395317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.395946 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.397743 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d5e0f-af03-42bd-a94a-a3353ded8938 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.409913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1289/2581] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 06:57:46.414088 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.424571 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd1569-b19f-4b4d-a1e6-6fc490778e16 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.430385 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.431029 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.431301 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.431562 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] PATH_INFO: `/v3/projects/30ef0f06dc5842b8985e252a8b5dc817/users/ec8d20785b684ec0bbb1cc181e1257b4/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.446771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ef0f06dc5842b8985e252a8b5dc817, user_id=ec8d20785b684ec0bbb1cc181e1257b4, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.449431 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.464058 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1293/2582] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:46 2022] PUT /identity/v3/projects/30ef0f06dc5842b8985e252a8b5dc817/users/ec8d20785b684ec0bbb1cc181e1257b4/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:57:46.476962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.477479 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.477624 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.507206 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] MFA Rules not processed for user `ec8d20785b684ec0bbb1cc181e1257b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:46.508420 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:46.584597 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1290/2583] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:46.589361 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.603642 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:46.652692 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a514-bf74-4e3b-a7ca-1b6e2b40a20c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.657886 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.658490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.658763 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.659028 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.659677 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.661620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.690926 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1294/2584] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:46.695699 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.706525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fc20b-f526-4a53-8487-887ba794c698 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.726711 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:46.767900 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.768493 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.768766 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.769165 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.769792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.771735 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.793761 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1291/2585] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:46 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:57:46.797911 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.808570 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23271692-58fa-4fcb-8e87-4cf30fbbc693 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.813358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.813953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.814215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.814485 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.815126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.816719 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.827964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1295/2586] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:46.832133 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.842333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1671f-15a0-4944-ab26-5fb300b4318f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.847148 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.847790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.848060 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.848324 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] PATH_INFO: `/v3/projects/74733800090246d4ab18de26f2c72e8a/users/762e5133370f4f14b26d1e064501244a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.863242 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74733800090246d4ab18de26f2c72e8a, user_id=762e5133370f4f14b26d1e064501244a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.865980 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.880316 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1292/2587] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:46 2022] PUT /identity/v3/projects/74733800090246d4ab18de26f2c72e8a/users/762e5133370f4f14b26d1e064501244a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:57:46.884663 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.895042 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee2e8-7509-45a1-bae4-d3d80c92f55c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.953499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.954026 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.954287 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.954533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.955183 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:46.956771 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e55bbd-773e-4153-b05b-f384446ac777 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:46.966669 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1296/2588] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:46.971506 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:46.988384 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430928a-45a6-4ce6-90cb-030c5a0f375a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:46.994538 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:46.995194 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:46.995468 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:46.995740 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] PATH_INFO: `/v3/projects/74733800090246d4ab18de26f2c72e8a/users/762e5133370f4f14b26d1e064501244a/roles/b04fbf57ace9402ca3e538592635ef5f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:46.997710 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74733800090246d4ab18de26f2c72e8a, user_id=762e5133370f4f14b26d1e064501244a, role_id=b04fbf57ace9402ca3e538592635ef5f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:47.000333 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:47.011530 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1293/2589] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:46 2022] PUT /identity/v3/projects/74733800090246d4ab18de26f2c72e8a/users/762e5133370f4f14b26d1e064501244a/roles/b04fbf57ace9402ca3e538592635ef5f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:47.021573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:47.021855 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:47.022126 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:47.049751 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] MFA Rules not processed for user `762e5133370f4f14b26d1e064501244a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:47.050947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:47.129140 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1297/2590] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:47.140940 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:47.143059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:47.200949 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ef6ed-46e9-4d16-a3d3-03f8860ffa5a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:47.204966 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:47.205525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:47.205842 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:47.206078 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:47.215381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:47.216792 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:47.229523 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1294/2591] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:47.317684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:47.328031 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8c66-b89e-49a6-9da8-45300317ad4c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:47.331798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:47.332393 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:47.332681 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:47.332946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:47.338175 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:47.391009 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:47.392435 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f266f2-666f-44c5-b077-a1657db807e9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:47.401822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1298/2592] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:52.232656 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:52.296075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517e7ed-f4e6-4cd1-8e8d-93b7b3141852 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:52.300726 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:52.301409 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:52.301658 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:52.301927 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] PATH_INFO: `/v3/users/ec8d20785b684ec0bbb1cc181e1257b4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:52.303066 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8d20785b684ec0bbb1cc181e1257b4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:52.304984 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:52.328186 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:52.359275 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8d20785b684ec0bbb1cc181e1257b4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.367992 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8d20785b684ec0bbb1cc181e1257b4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.380115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8d20785b684ec0bbb1cc181e1257b4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.380768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8d20785b684ec0bbb1cc181e1257b4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.387780 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8d20785b684ec0bbb1cc181e1257b4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.393574 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1295/2593] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:52 2022] DELETE /identity/v3/users/ec8d20785b684ec0bbb1cc181e1257b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:52.398215 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:52.398850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:52.398850 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:52.418920 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:52.420147 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:52.479589 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1299/2594] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:52.489635 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:52.491181 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:52.550993 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568ccb-d7a9-4357-8ba1-2a229e27f298 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:52.555562 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:52.556172 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:52.556442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:52.556716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:52.567089 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:52.568892 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:52.578628 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1296/2595] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:52.857315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:52.858811 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:52.871171 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a125f46-fa19-49ef-a0b2-a64229ff8a5c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:52.875922 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:52.876631 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:52.876963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:52.877315 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] PATH_INFO: `/v3/projects/30ef0f06dc5842b8985e252a8b5dc817` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:52.878496 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ef0f06dc5842b8985e252a8b5dc817)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:52.880490 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:52.930542 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ef0f06dc5842b8985e252a8b5dc817', 'request_id': 'req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.938798 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ef0f06dc5842b8985e252a8b5dc817', 'request_id': 'req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.944836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ef0f06dc5842b8985e252a8b5dc817', 'request_id': 'req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.955816 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] The token cache is being invalidate because project 30ef0f06dc5842b8985e252a8b5dc817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:52.956097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.956734 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:52.958254 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1300/2596] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:52 2022] DELETE /identity/v3/projects/30ef0f06dc5842b8985e252a8b5dc817 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:57:52.962366 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:52.972114 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127fb4-dd39-4c02-b337-641b19b31831 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.028005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.028630 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.028898 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.029203 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] PATH_INFO: `/v3/users/762e5133370f4f14b26d1e064501244a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.030427 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762e5133370f4f14b26d1e064501244a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.032345 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.078889 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:53.081579 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762e5133370f4f14b26d1e064501244a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.090155 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762e5133370f4f14b26d1e064501244a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.102004 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762e5133370f4f14b26d1e064501244a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.102568 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762e5133370f4f14b26d1e064501244a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.109294 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5db34270-0b5b-4f38-9c51-274b2696ae49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762e5133370f4f14b26d1e064501244a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.115016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1297/2597] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:57:52 2022] DELETE /identity/v3/users/762e5133370f4f14b26d1e064501244a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:53.391990 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.393507 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:53.407037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5faf-1633-45fc-b7e5-50b159b43c8d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.436916 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:53.466505 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.467136 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.467410 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.467697 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] PATH_INFO: `/v3/projects/74733800090246d4ab18de26f2c72e8a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.468822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74733800090246d4ab18de26f2c72e8a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.470765 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.519715 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74733800090246d4ab18de26f2c72e8a', 'request_id': 'req-947bf903-15a4-4b15-b7da-21245eec9d99'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.530035 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74733800090246d4ab18de26f2c72e8a', 'request_id': 'req-947bf903-15a4-4b15-b7da-21245eec9d99'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.536239 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74733800090246d4ab18de26f2c72e8a', 'request_id': 'req-947bf903-15a4-4b15-b7da-21245eec9d99'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.548379 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] The token cache is being invalidate because project 74733800090246d4ab18de26f2c72e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:57:53.548655 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.549316 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-947bf903-15a4-4b15-b7da-21245eec9d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:57:53.550964 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1301/2598] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:57:53 2022] DELETE /identity/v3/projects/74733800090246d4ab18de26f2c72e8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:53.555932 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.556442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.556442 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.578592 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:53.579790 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:53.641358 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1298/2599] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:53.650498 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.650780 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.651178 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.671603 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:53.672809 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:53.681997 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1302/2600] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:53.686558 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.697191 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19616f-4d41-438e-9feb-381d277bd397 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.704734 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.705640 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.705975 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.706320 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.707276 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:57:53.707667 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.710182 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.723578 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1299/2601] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:57:53.728288 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.741873 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95051039-3649-4de3-b4b9-47c6290c82d1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.748794 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.749441 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.749709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.749967 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.750590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.752476 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.783482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1303/2602] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:57:53 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:53.787962 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.798219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272d64b-9785-4c31-8ee0-1eb7d9ba051e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.857373 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.857988 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.858257 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.858522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.859143 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.861134 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.884629 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1300/2603] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:57:53 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 06:57:53.888823 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.899491 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e32aa3-623b-477d-b6ca-305ba0b6d4bc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.904367 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.904963 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.905266 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.905535 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.906195 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.907786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.917845 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1304/2604] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:53.921906 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.932123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b0e37-f644-4feb-8a58-a04f15b7f2c6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.937445 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.938044 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.938317 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.938619 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.939255 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.940843 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff8258-fbf1-4caa-8672-7f6022c5c9c5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:53.952076 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1301/2605] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:57:53.956376 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:53.968620 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511bf13-cae2-41da-9a94-80d22b642bc3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:53.975151 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:53.975797 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:53.976077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:53.976343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] PATH_INFO: `/v3/projects/137f9acb5590473da6d33714ccc6e762/users/7400b289efde43f18f4b41cc58fff68d/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:53.991538 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137f9acb5590473da6d33714ccc6e762, user_id=7400b289efde43f18f4b41cc58fff68d, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:53.994211 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:54.009489 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1305/2606] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:57:53 2022] PUT /identity/v3/projects/137f9acb5590473da6d33714ccc6e762/users/7400b289efde43f18f4b41cc58fff68d/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:57:54.014697 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259661-2bb6-4cbc-af90-b9820ec046b7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:54.014979 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259661-2bb6-4cbc-af90-b9820ec046b7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:54.015246 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259661-2bb6-4cbc-af90-b9820ec046b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:54.034195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ec259661-2bb6-4cbc-af90-b9820ec046b7 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:54.035391 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ec259661-2bb6-4cbc-af90-b9820ec046b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:54.062122 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:54.104173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1302/2607] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:54.114083 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:54.115958 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:54.177684 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fef9e-0633-47d0-ac60-3126c00a1a58 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:54.181580 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:54.182187 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:54.182460 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:54.182727 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:54.192173 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:54.193996 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:54.199112 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:57:54.204504 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1306/2608] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:54.837731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758540-35b9-4b51-a2ef-69f56d7037e4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:54.838313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758540-35b9-4b51-a2ef-69f56d7037e4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:54.838313 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8758540-35b9-4b51-a2ef-69f56d7037e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:54.866118 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d8758540-35b9-4b51-a2ef-69f56d7037e4 None None] MFA Rules not processed for user `7400b289efde43f18f4b41cc58fff68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:54.867332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d8758540-35b9-4b51-a2ef-69f56d7037e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:54.938881 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1303/2609] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:54.950459 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:54.951978 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:55.011689 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b0b8-89c3-42a9-a2b6-9f055f2f642f service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:55.015399 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:55.016003 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:55.016270 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:55.016499 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:55.025511 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:55.027103 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:55.036158 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1307/2610] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:56.409289 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:56.409851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:56.409851 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:56.430789 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] MFA Rules not processed for user `7400b289efde43f18f4b41cc58fff68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:57:56.431990 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:56.439695 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1304/2611] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:57:56.679527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:56.681203 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:56.695247 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf98e8-4b76-462d-bf1c-ceff1baadc1c service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:56.699866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:56.700479 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:56.700787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:56.701109 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:56.702874 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:56.713190 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:56.714760 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:56.724895 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1308/2612] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:57.053164 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:57.055376 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:57.061440 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:57.071053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c37f8-f304-42d4-ad44-37c38fff0c8d service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:57.075194 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:57.075802 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:57.076077 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:57.076338 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:57.078383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:57.127820 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3d3f9-3b0a-4b9a-bd5f-4813519555e1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:57.133459 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:57.134075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:57.134354 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:57.134621 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:57.136353 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:57.148075 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:57.149685 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:57.152650 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:57.154246 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:57.159853 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1305/2613] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:57.165931 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1309/2614] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 06:57:58.950926 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:58.961896 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b07f58-0c22-4ea3-9b79-a32097ad50a0 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:58.966173 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:58.966768 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:58.967042 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:58.967338 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:58.969185 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:58.978897 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:58.980310 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6891520-dbd9-4a74-bba0-0621d9e49646 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:58.988381 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1306/2615] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:57:59.623368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:57:59.625910 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:59.641217 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770278ad-dccd-4bd1-9d94-9be55c4b8db7 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:57:59.646951 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965ff63b01c04728b214e71933f87792', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:57:59.647569 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:57:59.647840 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:57:59.648104 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:57:59.650033 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:57:59.663281 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:57:59.664899 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7747-36f9-499a-b978-cd57c7149a78 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:57:59.676638 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1310/2616] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:58:08.984770 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:09.672846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=72 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:10.772197 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:10.772716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:10.772716 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:10.792807 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] MFA Rules not processed for user `7400b289efde43f18f4b41cc58fff68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:10.794107 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:10.802219 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1307/2617] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:20.787038 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:29.032961 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4752622-8d91-4d4c-8f4e-1dd07c943d54 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:29.033482 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4752622-8d91-4d4c-8f4e-1dd07c943d54 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:29.033600 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4752622-8d91-4d4c-8f4e-1dd07c943d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:29.085450 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a4752622-8d91-4d4c-8f4e-1dd07c943d54 None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:29.086646 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a4752622-8d91-4d4c-8f4e-1dd07c943d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:29.154836 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1311/2618] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 11 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:29.209991 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:29.211553 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:29.306522 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3ce7-a1d8-41c2-8e4f-548727341d9f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:29.311999 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:29.312611 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:29.312885 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:29.313298 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:29.322156 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:29.323731 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:29.332098 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1308/2619] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:58:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:58:39.151605 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=40 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:39.328860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=41 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:43.686303 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:43.686787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:43.686894 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:43.707929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] MFA Rules not processed for user `026603d0fbbd4770b3cc8564c35ca2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:43.709166 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:43.717448 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1312/2620] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 11 06:58:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:43.730073 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:43.741144 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b45f60-647f-42f7-be07-ca41298dae89 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:43.746749 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4ea301b8f046c3b9a7e4737775c5f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:43.747364 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:43.747642 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:43.747891 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:43.757029 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:43.758652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:43.767082 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1309/2621] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 11 06:58:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 06:58:45.721585 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:45.734096 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f461f-2030-4550-a70d-95ecd134bdad None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:45.739818 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:45.740444 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:45.740755 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:45.740927 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] PATH_INFO: `/v3/users/7400b289efde43f18f4b41cc58fff68d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:45.742237 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7400b289efde43f18f4b41cc58fff68d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:45.744242 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:45.791945 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7400b289efde43f18f4b41cc58fff68d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:45.792614 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7400b289efde43f18f4b41cc58fff68d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:45.800821 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7400b289efde43f18f4b41cc58fff68d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:45.814402 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7400b289efde43f18f4b41cc58fff68d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:45.822343 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d6bb6050-a15d-4f10-9b5d-de09381f5e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7400b289efde43f18f4b41cc58fff68d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:45.828944 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1313/2622] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:58:45 2022] DELETE /identity/v3/users/7400b289efde43f18f4b41cc58fff68d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:58:46.011046 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.022135 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf17ca-968b-4d2b-afd7-1dc77184a0da service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.084216 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.084854 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.085167 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.085443 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] PATH_INFO: `/v3/projects/137f9acb5590473da6d33714ccc6e762` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.086588 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137f9acb5590473da6d33714ccc6e762)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.088496 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.134309 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137f9acb5590473da6d33714ccc6e762', 'request_id': 'req-aa853c4b-3284-4e74-a508-c2da7457e1d7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:46.142719 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137f9acb5590473da6d33714ccc6e762', 'request_id': 'req-aa853c4b-3284-4e74-a508-c2da7457e1d7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:46.148474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137f9acb5590473da6d33714ccc6e762', 'request_id': 'req-aa853c4b-3284-4e74-a508-c2da7457e1d7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:46.160844 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] The token cache is being invalidate because project 137f9acb5590473da6d33714ccc6e762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:58:46.161139 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:46.161913 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-aa853c4b-3284-4e74-a508-c2da7457e1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:58:46.163510 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1310/2623] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:58:46 2022] DELETE /identity/v3/projects/137f9acb5590473da6d33714ccc6e762 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:58:46.168666 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.168953 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.169250 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.189761 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:46.190982 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:46.252849 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1314/2624] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:46.260648 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.260835 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.261158 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.281355 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:46.282567 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:46.291159 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1311/2625] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:46.295573 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.305827 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0267a92-e9c9-41fb-80c8-d24bd1578151 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.311255 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.311861 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.312130 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.312394 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.313037 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 06:58:46.313368 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.314977 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.327709 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1315/2626] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 11 06:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 06:58:46.331968 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.341475 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4027-90d3-4b72-8e18-5e46a9c2bf92 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.346693 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.347281 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.347525 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.347788 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.348430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.350372 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.380936 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1312/2627] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 11 06:58:46 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:58:46.386328 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.396947 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6428e-5883-4068-9a69-e15011bad9b5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.454930 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:46.466924 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.467786 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.468057 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.468321 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.468946 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.470962 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.493392 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1316/2628] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 11 06:58:46 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 06:58:46.497659 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.507775 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9abb-696b-4b5c-a944-72a797bc0a40 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.513059 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.513612 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.513882 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.514147 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.514850 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.516438 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.526772 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1313/2629] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:58:46.530787 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.541335 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7f94e-44f5-4f03-a490-90be0d7d42e1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.547395 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.547991 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.548231 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.548492 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.549164 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.550781 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bb7d0-1f24-4ce9-ac96-ce704e032c40 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.562722 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1317/2630] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 11 06:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 06:58:46.566866 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.579818 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e58be-b03a-4c33-8de9-69931e122e15 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.585465 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.586115 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.586385 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.586652 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] PATH_INFO: `/v3/projects/00f35146886a4b02822e5a1c031c15c0/users/796dc9f93a9e4d3c815ac778592e3fd0/roles/13d7deed477f4bb486fee9fa5d749deb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.602410 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f35146886a4b02822e5a1c031c15c0, user_id=796dc9f93a9e4d3c815ac778592e3fd0, role_id=13d7deed477f4bb486fee9fa5d749deb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.605056 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.620024 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1314/2631] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 11 06:58:46 2022] PUT /identity/v3/projects/00f35146886a4b02822e5a1c031c15c0/users/796dc9f93a9e4d3c815ac778592e3fd0/roles/13d7deed477f4bb486fee9fa5d749deb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:58:46.630278 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.630553 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.630822 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.658882 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] MFA Rules not processed for user `796dc9f93a9e4d3c815ac778592e3fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:58:46.660080 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:46.731587 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1318/2632] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:58:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:58:46.743214 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:58:46.745195 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:58:46.760744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:46.806412 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5729815-3434-477e-bcc8-e28450b8b0f0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:58:46.810250 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd21a5a40ab384688bb267a44a749f085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:58:46.810860 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:58:46.811138 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:58:46.811447 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:58:46.820682 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:58:46.822183 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64a99f-4140-433b-8b1e-755fb99a1e5b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:58:46.831016 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1315/2633] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:58:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:58:56.728432 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:58:56.827126 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=20 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:20.382319 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:59:20.449314 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8601058-c40c-444a-acd9-02dc1c4222ad None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:59:20.455449 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:59:20.456084 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:59:20.456358 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:59:20.456622 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] PATH_INFO: `/v3/users/796dc9f93a9e4d3c815ac778592e3fd0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:59:20.457883 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796dc9f93a9e4d3c815ac778592e3fd0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:59:20.459846 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:59:20.509216 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796dc9f93a9e4d3c815ac778592e3fd0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:20.510122 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796dc9f93a9e4d3c815ac778592e3fd0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:20.519133 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796dc9f93a9e4d3c815ac778592e3fd0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:20.530647 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796dc9f93a9e4d3c815ac778592e3fd0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:20.537626 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796dc9f93a9e4d3c815ac778592e3fd0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:20.543704 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1319/2634] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 11 06:59:20 2022] DELETE /identity/v3/users/796dc9f93a9e4d3c815ac778592e3fd0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 06:59:20.548495 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:59:20.548982 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:59:20.549123 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:59:20.579312 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] MFA Rules not processed for user `1ad2c06f6db742138db606ece6f8f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 06:59:20.580531 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:59:20.643332 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1316/2635] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 11 06:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 06:59:20.653696 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:59:20.655283 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:59:20.716424 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadb006-b0e6-404d-a688-650a7276dae4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:59:20.721039 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0294ac726964601b44f1d63cb1c2c50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:59:20.721662 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:59:20.721929 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:59:20.722193 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:59:20.734076 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:59:20.735500 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:59:20.745294 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1320/2636] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 06:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 06:59:21.025915 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 06:59:21.027464 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 06:59:21.040025 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce472-2183-4cce-8716-e279a2dfaf11 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 06:59:21.045561 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ad2c06f6db742138db606ece6f8f0c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5a17a08f1b4f70b45357309fc45101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 06:59:21.046230 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 06:59:21.046474 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 06:59:21.046777 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] PATH_INFO: `/v3/projects/00f35146886a4b02822e5a1c031c15c0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 06:59:21.048005 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f35146886a4b02822e5a1c031c15c0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 06:59:21.049997 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 06:59:21.100017 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f35146886a4b02822e5a1c031c15c0', 'request_id': 'req-7e913c49-862b-4074-a21e-5ecb2be5bde2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:21.110871 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f35146886a4b02822e5a1c031c15c0', 'request_id': 'req-7e913c49-862b-4074-a21e-5ecb2be5bde2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:21.116494 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f35146886a4b02822e5a1c031c15c0', 'request_id': 'req-7e913c49-862b-4074-a21e-5ecb2be5bde2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:21.128146 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] The token cache is being invalidate because project 00f35146886a4b02822e5a1c031c15c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 06:59:21.128430 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:21.129177 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7e913c49-862b-4074-a21e-5ecb2be5bde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 06:59:21.130744 dv-cinder-854954-3-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1317/2637] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 11 06:59:21 2022] DELETE /identity/v3/projects/00f35146886a4b02822e5a1c031c15c0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 06:59:30.741048 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:59:31.124942 dv-cinder-854954-3-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 07:00:20.927949 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 07:00:20.930097 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 07:00:21.076206 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925ab5-fc26-4a21-9c42-d3171f9022a0 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 07:00:21.148416 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2b49f6dc22e4831951be6d7192226c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec6b8f1321034cbeabf9632b50726f21', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 07:00:21.149053 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 07:00:21.149329 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 07:00:21.149590 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 07:00:21.151815 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 07:00:21.163866 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 07:00:21.165527 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f40b11-e24e-4dc8-ac5d-50ff8f6b4c23 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 07:00:21.175533 dv-cinder-854954-3-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1321/2638] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 11 07:00:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 07:00:31.171383 dv-cinder-854954-3-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}